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Introduction 



It was just a little over a year ago that the report of the 
National Commission on Excellence fn Education was Issued. This 
report has had a great Impact not only on educators but also on the 
general public, itesponses to the report have been written, 
coraroittees and task forces formed, and reform legislation has been 
passed. The findings and recommendations of this report, as well as 
several other important national studies, have provided an impetus 
for change and a focal point for discussion among educators and 
concerned members of the community. 

The reports accomplished their purposes: the level of concern 
is high, the public is aware of the problems and needs of the 
schools, and improvements are expected. There is an opportunity for 
everyone involved in the public education system to capitalize on the 
momentum generated by the national reports and to propose and enact 
school improvement strategies. 

What will it take to do this? Most all the national studies 
recognized a need for administrators and teachers to make use of the 
data and findings of educational research, A substantial body of 
knowledge has been generated on effective instructional strategies, 
on school and classroom management and on school improvement, 
processes that will facilitate educators' efforts. 

A central purpose of these three state conferences was to 
provide a forum fo** infonnation exchange between educational 
researchers and practitioners. Far West Laboratory, working in 
cooperation with the state departments of education in California, 
Utah and Nevada, invited outstanding members of the educational 
research community to share their findings and perspectives with 
other educators in the region. 

The Utah conference was held in Salt Lake City, September 13-14; 
the California conference was held in San Francisco, November 16-18; 
and the Nevada conference was held in Reno, February 2-3. Since most 
of the presentations were not given at more than one Cw.iference, ISP 
decided to combine the proceedings of all three conferences and make 
them available to participants and educators in all three states. 

The proceedings are divided into chaoters that reflect the 
organization of the conference agendas. Some of the presentations 
are edited transcripts of an overview or personal perspective; some 
are research reports, and others are descriptions of activities 
conducted In small group sessions. 



A11 tnree conferences were well attended and received favorable 
reviews by participants. We hope tbat sone of the "good Ideas" and 
research findings presented at these conferences will be helpful to 
educators In tt» planning and decision making associated with their 
school Improveajent efforts. Me also hope these conferences will be 
only the first of many opportunities for exchange among educators In 
the region. 

We would like to acknowledge the three state departments of 
education as partners In the planning and production of the 
conferences: Utah Superintendent Lee Burnlngham and his staff 
members Lerue Winget, Bruce Griff en and Fran Peek; Nevada 
Superintendent Ted Sanders and his staff members f^yrna Hatranga and 
Al Ramirez; and Harvey Hunt. Cathy Barkett. Laura Wagner and Phil 
Daro of the California State Department of Education. In Utah, the 
conference was co-^ponsorec* Ti*h the Utah State Board of Education 
and the University of Utah rac ^te School of Education. In 
California we had assistance fr . the Association of California 
School Administrators, the Educational Testing Service and Division 6 
of the American Educational Research Association. 

ISP staff members, Stanley Chow, Carol Murphy, Tom Ross, Mary 
Dean and Ellen Hui all worked on various aspects of the planning, 
production and documentation of these conferences. Finally, we 
acknowledge the support of the National Institute of Education in 
helping to make these conferences possible. 



Lynn Jenks 

Director, improvement Support Program 



June 198< 



Table of Ccmtents 



Chapter 1 
Perspectives on Effective Schools 

A Perspective on Effective Schools 3 

Strategies for Effective School Ifnproveinent Programs 13 

Organizing and Delivering Curriculum for Maximum Impact 21 

A Delphi Analysis of the Instructlonally Effective School 39 



Chapter 2 
Principalship 

Issues for School Improvement 57 
Three Principal Styles of racllltating School Improvement 71 

T-^n--^ nail 

Instructional Management Academy 83 

?7'u rir^.Ltt n[y^,i Ginnu Lee 



Chapter 3 
Teacher Effectiveness 

Research and Teacher Ef fecti venesi 89 

Teacher Effects 109 

Current Research on Effective C'tassroom Management 135 

Research on Teacher Expectations 151 



ERIC 



8 



Critical Thinking Skills 

Steps Toward Promoting Cognitive Achievements 167 

Philip H, Wirme 

Designing an Integrated Instructional and Assessment System for 189 
Critical Thinking Skills 



Chapter 5 
Staff Development 

Moving Toward Continuous Scnool Improvement 213 

Judith Warren Littl- 

Effectlve Staff Development 223 

Robert N, Bush 

Management Development at Hewlett-Packard 241 

Williar P, SilsBcn 

School Improvement Through Staff Development: The Coaching of Teaching 251 

Bt;verlu ShOLievn 

Improving Instruction with School-Site Support Teams 259 

«7744f Guilkeu-Amado, Ellen Nim and Dorothy Elliott 

The California Mentor Teacher Program 271 

L/^ur'-i A, Warmer 



Chapter 6 

Microcomputer Applications in Education 

Microcomputer Applications in Education: Now to Next Decade 279 

Lkivi l M-'uraund 

The Software Problem 287 

Derfker F. Valker 

The Gap Between Promise and Reality in Computer Education: 295 
Planning a Response 

\ Linn and Fisher 

The California Model Curriculum for Computers In Education 317 



er|c 



9 



CHAPTER 1 

PERSPECTIVES ON EFFECTIVE SCHOOLS 
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7 sometimes pef very c^/BSsecf atXHJt John Dewey. He is far more 
often quoted than read ttmse days. It is possible for smreone to get a 
Ph. D. in education without ever having read a of Demy." 

"Pay heed to people like GoodarKlBrophy when they say cbn't confuse 
effective schools with good schools — if by effective you nnean sctKX)ls 
in which test scores /Tawe gone up, Vbur jc^isnc^ over wnen the test 
scores ha\^ gone up: it has just degw/i." 

"/ 'dlike to sug^st a view of an effective school that you will treat as out- 
rageous I think we ought to define effective sct^s as those that are 
educative settings for teachers. To put it another way, I will define as in- 
effective any school that is so organized that the teachers on that faulty 
cannot be active learners with as much serious support for that role as 
the students get" 

'Changing the conditbns of teaching is a little bit like trying to change 
the quality of a large lake. It took many years to get itpdiutedandyou 're 
not going to be able to drop a tablet into it and change it overnight — 
which is why our policymakers, our union leaders, our school adminis- 
trators have gof to have vision." 



II 



A PERSPECTIVE ON EFFECTIVE SCHOOLS 



Lee S. SHulman 
Professor of Education and 
Affiliated Professor of Psychology 
Stanford University 



In 1963 I was interviewed for ray first joO at Michigan State 
University by Wilbur Brookover, the chairman of what was to be my 
department. Brookover had this mad Idea that there was something 
about school climate and school self -concept that was an Important 
determinant of what made school a good place. Of course all of us 
thought that that was all nonsense; It was hoM carefully and how 
behavioral 1y your objectives were defined that made the difference. 
But the madness of the sixties passed and Brookover's wisdom was 
later recognized. 

What I'd like to do today is to provide same perspective on the 
discussion of effective schools. The perspectne will require talk- 
ing a bit about the past because one of the qici»st1ons we might raise 
is, "Uhat were we all doing before we were talking about effective 
scnools?" Uasin't anybody concerned with school improvement, and If 
so, what were they doing? What was guiding our efforts before we had 
the research data we now have? 

I find that my doctoral students tend to be Incredibly ahislori- 
cdU For them it's an embarrassment to cite a reference that', more 
than four years old, and I practically have to bludgeon them into 
taking a course in the history of education, So I hoj« you'll bear 
with me If I begin with some discussion of past attempts to improve 
schooling. It may put some perspective on what we're, doing now and 
since there's a cyclical quality to educational trends, it may also 
give us some idea of what the future may bring. 



Early Images of Effective School iny 

Let me go back to the beginning of this century. On what 
grounds did people talk about what a good education was, what a good 
teacher was, what a good school was In 1900 or 1905? They had all 
kinds of very precise discussions about who were better or poorer 
teachers, which were better or poorer schools. But by today's 
standards these discussions were very unscientific. Ih^y didn't have 
test scores to use at the time. All they had were values. All they 
had were philosophies of education. All they had were cc^nmitments 
and ideolonies and well -debated views of the good life and what 
knowledge was most worth. They had a lot that we in our slavish 
acceptance of "scientific criteria of outcomes" may have lost as part 
of the price of our progress. And one of the messages I'll try to 
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ledve you with fs that we not forego the progress we've fiia^e 
through the applications of social science, but perhaps If we return 
to some concern for those values and perspectives we'll be further 
ahead. 

let qie tell you what I ^an. The most Important Influence on 
the thlnKiJig about teeR^hlng that occurred In those days was the work 
of John Oewey* I sometimes ^t very depressed about John Dewey. 
Like another great thinker of his age, Sigmund Freud, he Is far more 
often quoted than read these days. It Is possible for someone to get 
a Ph.O. In education without ever having read a page of Ctow€ty. But 
there was a Oewey, and he did have quite an Impact. The Impact he 
had was In communicating to several generations of educators an Image 
of the good classroom and the good school. The Image was based on 
his concept of a good society, a democratic society In which people 
made decisions about their respective well-being through delibera- 
tion, through discussion, through the exercise of reason and 
knowledge. 

And If this was the way a good society looked, then It ought to 
be mirrored at every level of society— so that a government should 
work that way, a school should work that way, and a classroom should 
Mork that way. That was his first point. His second point was that 
if children were to grow up to be adults who had to take their place 
In that kind of society they had to have practice. Teachers need 
practice; we call It practice teaching. Physicians need practice; we 
call It rotating Internships and residencies. Airline pilots need 
practice; they use simulators before they go out Into the real thing. 
Children need practice, and the practice environment for citizenry Is 
called a classroom according to Oewey. And If you knew what a good 
society looked like, you could go into a classroom and ask, "Is this 
the kind of place that's giving kids that opportunity?"' 

But Dewey was a very complicated man. He didnt stop there. He 
also had an Idea that knowledge was something that people invented. 
They produced it; they did It actively. It was called experimenting, 
devising Instruments to make the world reveal secrets It wasrrt going 
to reveal by Itself. It meant asking and inquiring. You didn't 
learn about the world from sitting back until It told you something 
Mhen It felt like it. Given this idea of knowledge, someone could go 
Into a classroom and watch the way knowledge was dealt with In that 
classroom, and he could say, "Yes, that is an approximation of the 
May in which knowledge is created and transmitted," or "No, that is 
not." 

What I'm coming to here is the notion that there were images of 
good education, of go<Kl teaching and good learning, of good school 
settings, and they were not naive or ideological. They came from a 
very careful and thoughtful appraisal. And it wasn't only Dewey; 
there were many others as well who spoke not only of what it meant to 
gain knowledge and competence so that you could be a productive 
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member of a defflocrstu society but also of hfm to apply t^ose princi- 
ples to the study of scliools. 

Ralph Tyler and Ms group at Ohio State and then later at the 
University of Chicago con^leted Uie oiost rei^rkable and extensive 
study of schools ever done— the Eight Year Study. It was a 
remarkable studiy of progressive schools and their conse<iuences. The 
study was based on a normative concept of good schooling. 

Let me now distinguish betwe«) a normative view of a good school 
and what I'll call an empirical view. An empirical view defines a 
good school by its outc<Hnes*-a change In test scores, or employment 
rate, decreases In delinquency rates, improved attendance rates or 
some combi nation of these. You define what a good school Is on the 
basis of measures of these empirically derived outcomes. A normative 
view of a good school Is the view that f ve been describing In tlie 
Itfst few minutes. This view is based on an analysis of what you 
believe is of greatest value and Is determined by the comparison 
between those standards and what you observed* 

let me give you a specific example of this normative approach. 
We're used to looking at effective teaching studies by asking the 
question ''Which of these approaches obtains the highest gains in 
reading performance?" But a very influential study was done a few 
years ago by Dolores Durkin at the University of Illinois Center for 
the Study of Reading. She went to a number of classrooms and asked 
d somewhat different question: "Can I find any instances in which 
reading comprehension is taught, and if so under what conditions?" 
She didn't go out looking for outcomes; she had a normative model, a 
model of what reading comprehensive instruction looked like. She 
distinguished between having the child read silently and fill out a 
work sheet and giving the child some instruction about how to compre- 
hend, followed by strategies for making sense out of readlrg pas- 
sages. She wasn't asking, "How do students do on test scores?"; she 
was saying, "Can I find examples of that kind of instruction, and if 
so under what condUions?" That's an example of an effectiveness 
study that uses a normatTve criterion. And as some of you may know, 
her results were very distressing. She found almost no instances of 
instruction in reading comprehension. When she asked teachers if 
they taught comprehension, the answer was always yca. But when she 
asked how, it was almost always, "they read and then I give them 
comprehension exercises to fill out and I mark them and I give them 
back." 

a 

During the late fifties and early sixties, the kind of research 
that was done on effectiveness in general was normative. In these 
studies the outcomes were based on democratic values, not empirical 
indicators of achievement. And it is out of this atmosphere that 
what we now identify as the effective schools movement then 
developed. It was a very important movement —and it still is. The 
late sixties was the er., jf the Coleman Report —when we were told 
that schools didn't make much of a difference, that there are other 
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more powerful influences fn the socletjf. At the same time this was 
the era of the student uprisings, the 1968 Democratic Convention ami 
Kent State. People began to get very skittish about the absence of 
discipline, the absence of directlct, the absence of control in our 
schools. 

And somehow out of this matrix developed a very fascinating body 
of research. It*s the research which to this day has continued as 
the mainstream of effective teaching and effective schools research. 
It Is an empirical stream that says we can Identify the patterns of 
teaching In classrooms and the forms of organization and management 
in schools that predictably result In Increased performance on 
achievement tests for young people. Schools do make a difference, 
and, in fact, the way thisy make a difference Is by foregoing a lot of 
this Deweyan nonsense and putting the control back In the han4s of 
the teachers. An extraordinarily well -crafted tradition of research 
on direct Instruction and t1me-on-task changed the rules by saying 
the normative view Is Inadequate. We cant simply go 1n and apply 
these general images of the good school. We've got to anchor these 
judgments in something we can depend on, and let's try achievement 
test scores. At the same time, researchers acknowledged that test 
scores don't measure everything that's worthwhile about a school. 
They are an Indicator of an Important but narrow range of what 
schools are about. They have continually warned us not to confuse 
effectiveness as measured by that standard with effectiveness in 
general. Don't confuse the score for everything else the school Is 
responsible for accomplishing. 



Three Nightmares about Educatio n 

About a year ago I was asked to comment on an emerging conflict 
between policymakers who wanted to fulfill their obligations to 
improve the quality of schooling for all children by writing regula- 
tions that would ensure all kids an equal opportunity and the 
teaching profession that said, "We know what we're doing. Don't try 
to mandate everything we do." Let me share with you the observations 
I made at that time. By the way, they appear in a book that Gary 
Sykes and I have edited called The Handbook of Teaching and Policy. 

I began by saying that what unfortunately motivates people to 
choose courses of action is rarely the ideals they pursue; more often 
it's the nightmares they're trying to avoid. We often choose what we 
want to do to avoid what frightens us rather than out of the motiva- 
tion to accomplish what we value most. The participants in the 
struggles over teaching and public policy all have their nightmares. 
Many of the policymakers have a vision of teachers who do not teach— 
or teach onb what they please to those who please them, who prefer a 
transient fad to the tougher less rewarding regimen of achieving 
tangible results in the basic skills, who close their schoolhouse 
doors and hide their incompetence behind union-sheltered resistance 
to accountability and merit pay, whose low expectations of the Intel - 
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lectudi prowess of poor children lead them to neglect their 
pedagogical duties toward the very groups who need instruction most 
desperately, or whose limited knowledge of the sciences, mathematics, 
and language arts results in their misteaching the most able. Many 
policymakers see an unwilling or inept teacher resisting the Imple- 
pientation of policies based on research that are designed to Help 
children and to benefit the greater society. That's the policy- 
maker's nightmare. 

Teachers have their own nightmare, that of a tesieged and belea> 
gurad group of dedicated professionals, inadequately appreciated or 
compensated, attempting to Instruct reasonably and flexibly under 
Impossible conditions. They are subject to countless mandates and 
directives emanating from faceless bureaucrats pursuing patently 
political agendas, (tot only do these policies frequently dictate 
absurd practices, but they also typically conflict with the policies 
transmitted from other agencies, from tt^ courts, or from other 
levels of government. Each new policy further erodes the teacher's 
control over the classroom for which he Is responsible. Pupils are 
yanked willy-nlll/ out of the room for special instruction, 
disrupting the continuity of their classroom experience and upsetting 
the normal flow of classroom life for everyone else. A larger number 
of children— bussed children and handicapped children->and 
Inexperienced aides must be accommodated in the classroom while at 
the same time the teacher must take on an extra hour a day of 
reading, a new writing initiative, more rigorous mathematics and 
science, sex education, bi^cultural education,* and in her spare time, 
carefully maintain the detailed individual records needed to create 
the bureaucrat's audit trail. That's the teacher's nightmare. 

So that teachers and bureaucrats weren't the only ones who were 
losing sleep at night, I thought it was Important to add to those two 
nightmares a third nightmare— the researcher's nightmare. Research- 
ers have their own version of the nightmare. In it they see both 
policymakers and practitioners pursuing their respective chores mind- 
lessly without benefit of the carefully collected, sifted, analyzed, 
and interpreted bodies of knowledge that constitute the stuff of 
educational scholarship. This body of work Includes both the most 
esoteric products of basic social science research and the concrete 
results of large scale surveys and experiments as well as the rich 
descriptive portraits of educational ethnographers. The scholar's 
nightmare is of an educational system at all levels uninformed by the 
wisdom of research, ungulded by the lessons of scholarship. 

I would add one additional nightmare, one that I think we see 
all too often. That's the nightmare that my teacher Joe Schwab 
referred to thirty years ago in an article he dubbed "On the 
Corruption of Education by Psychology." It Is the nightmare that 
occurs when a researcher, who can only do research by limiting a 
problem, by controlling variables, by focusing in on a rather limited 
set of events so that they can be. seen clearly and understood, finds 
those results applied broadly and generalized well beyond the 
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confines of the circumstances In t^hlch th^ were originally Investi- 
gated. So on the one hand, educational researchers say please don't 
overgeneratize our work, but on the other hand, please don't Ignore 
us. We've iMd a lot of experience being ignored, and we aren't 
saying to stop applylf^ our work* What we really siean Is look at It 
carefully, understand It In Us own terns, recognize Its Implications 
and Its limitations, and apply It judiciously. 

Making Your School Wore Effective 

What I'd 1 1ke to do In the last part of this talk is not to ask 
you to stop paying attention to the research on effective teaching 
and effective schools. No, I want you to pay more attention to It 
than you may have before*- 1 want you to take It seriously and the 
way to take It seriously Is to understand It for what It can and 
cannot do with respect to the guidance of educational policy and 
practice. Pay heed to people like G(K>d and Brophy when they say 
don't confuse effective schools with good schools— If by effective 
you mean schools In which test scores have gone up. Your job Is not 
over when the test scores have gone up; it has just begun. It may 
very well be that since almost all the effective schools research t^as 
been done in schools where test scores were very, very low to begin 
with and the job was to get them up to the national median, that the 
conditions for making average schools excellent may be totally 
different from the conditions for making poor schools minimally 
effective. That's one of those limltattons that's luilt into 
research. If you were doing medical research, you would not 
generalize from what's good for a common cold to \<hat's good for 
cancer. You'd know that solutions are situat ion -specific. Well, 
that's true in the social sciences and education as well. So one of 
the 1 important points I want to make is take the work seriously. Look 
at It with the kind of critical eye that the scholars who conduct the 
research use to look at each^ other's work and which real respect for 
that work would entail. 

Second, don't abdicate your obligations as educators to apply 
normative principles. The existence of standardized achievement test 
scores does not relieve us of the obligation to have a normative 
image of what a good classroom, good teacher, and good school ought 
to lootc like--an image that goes well beyond what any test can 
measure. We know what lousy curriculum is like. We know what it's 
like when kids are sitting and not using their heads at all in 
classrooms. And if the tests aren't picking up those differences, so 
much the worse for the tests. We've got to use our collective, 
practical, professional wisdom even more now than ever before. 
Education is one of those fields where very often the practice is 
ahead of the research. Right here in the city of San Francisco there 
are teachers who are teaching at a level of excellence that exceeds 
what any of our research models can explain. The last thing in the 
world I want them to do is stop what they're doing so that they can 
abide by the principles of effective schooling. Now some of their 
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work might get even better If they thought about these principles, 
but not If someone slraply slaps i mandate oil thetn. 

There's a new book called The Good High School by Sara Lawrence 
U9htfO(^, a good settrce of data on effective schools* It's an In- 
depth look at six American high schools: two of them are private 
elite schools In the East; two are suburban high schools; and two are 
Inner •city schools. The author spent a good deal of time In each of * 
those schools* and she has written a portrait of each. One of the 
things that just springs out at you Is how differently effectiveness 
Is defined at the different schools because they're starting In 
different places and (tealing with different problems. What Is 
appropriate at one Isn't appropriate at another. And they aren't 
just social class differences; they are differences In what Is 
problematic about teaching and schooling In these different settings. 
But there'^ another point that Sara Lightfoot makes. She writes 
about six utterly different Institutions and she asks herself, "Is 
there anything I can find In common about these institutions?" At 
the end of the book Sara has what she calls her group portrait where 
she dsks what do these places have In common? One of her obser- 
vations Is this: 

"Just as the principals in these portraits are seen as more 
complex and less dominant than their caricatures so too are teachers 
recognized as bolder and more forceful than their stereotypes would 
Imply, In all six schools I was struck by the central ity and 
dominance of teachers and by the careful attention given to their 
needs. To varying degrees the teachers in these schools are 
recognized as critical educational authorities— the ones who will 
guide the learning, growth and development of students most closely. 
Their intimacy with students^ and the Immediacy of their involvement 
with the substance of schooling puts them In a privileged and special 
position. In addition, school leaders who are more distant from the 
dally Interactions must depend upon teachers as major Interpreters of 
student behavior and values. They are positioned at the core of 
education," 



A Radical Criterion for Effective Schools 

That leads to my last point. I would like to suggest another 
image for you to carry around in your heads of what an effective 
school Is like— an Image that goes beyond the empirical view of a 
school that produces gains in test scores and goes beyond the Deweyan 
view of schools as places where children can learn to Inquire 
actively, create knowledge, and participate in a democratic society. 
I'd like to suggest a view of an effective school that you will treat 
as outrageous. I think we ought to define effective schools as those 
that ire educative settings for teachers. To put it another way, I 
will define as Ineffective any school that Is so organized that the 
teachers on that faculty cannot be active learners, with as much 
serious support for that role as the students get, ^tow I know that's 
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outrageous. I know 1t*s Irresponsible. I know that school is a 
place for kids to learn In, not for teachers to learn In. But I want 
you to suspend your good judgment for a moment and think about it. 
We know you can't be smart about everything you need to be smart 
about the day you enter the classroom for the first time. We also 
know that there aren^t a lot of opportunities to get smarter the way 
our careers are currently organized. So my question Is: If the 
quality of education for kids ultimately depends on how smart 
teachers are about their teaching and about their subjects, what 
better place for them to learn new things than in the school itself? 

I ask you to think about two kinds of Institutions. First, 
think for a moment about hospitals, especially our very best 
hospitals, our teaching hospitals* If you've ever been a patient in 
a teaching hospital, you have seen doctors come by on rounds. The 
professor, residents, interns, and medical students gather around the 
patient's bed, treating the patient as teaching material. This is 
not always a pleasant experience for the patient, but that is a topic 
for another day. They're doing this because they view one of the 
major functions of that hospital is to serve an educative purpose for 
its staff. The patient is an opportunity for Instruction. They have 
a weekly clinical pathological conference In which a different case 
is presented for the entire staff of the hospital. During this time 
the staff Isn't taking care of patients; they're meeting together on 
the job because they have an obligation as an institution to continue 
the professional development of the members of the Institution. 

You can justify creating Institutions that have as a major pur- 
pose the continuing educative value they have for their staff. For 
example, in the city of Pittsburgh the school board is allocating 
about a million and a half dollars a year for an Institution called 
the Schenley High School Teacher Center. It is a public high school 
that was scheduled to be closed. But they decided to keep it open, 
and they staffed it with fifty teachers drawn from the other eight 
high schools In the c1ty--teachers who were viewed as very competent 
by their peers and were Interested In being models for other 
teachers. There are twelve hundred students at the school, and the 
regular teaching load is three or four classes a day. Over a four 
year period, every high school teacher In Pittsburgh will rotate 
through the Schenley School for a period of eight weeks to watch 
other teachers, to have seminars, to study, to learn, to discuss, to 
think, to reflect, and then to go back to their home school and apply 
what they have learned. As each cadre of 50 teachers moves into 
Schenley from all over the city they are in turn replaced by a group 
called the replacement teachers, which Is the first cadre to have 
tjone through Schenley. 

Now the Schenley experiment could possibly fall short because 
theyVe pioneering at so many things at once. But It's exciting. 
It's something that we've got to watch because here is a school 
system that says we take responsibility for making our school dis- 
trict an educative setting for teachers. My dream is that after four 
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or five or six years Schenley High School will no longer be the one 
school in the district where you can go and be educated. But as more 
and more teachers filter through and go back» they will slowly begin 
to bring more and more of Schenley back to the remaining Pittsburgh 
high schools. 

k won't happen overnight. Changing the conditions of teaching 
IS a little bit like trying to change the quality of a large lake. 
It took many years to get It polluted and you're not going to be able 
to drop a tablet into it and change It overnight— which Is why our 
pel KyiTiakers, Our union leaders, our school administrators have got 
to have vision. They can't be expecting that quick payoff and the 
change In test scores tomorrow. Schenley represents what I mean when 
I say schools and school districts to be called effective must, in 
dddltion to what they can do for students, demonstrate that they are 
educative settings for teachers. I've suggested to some policymakers 
in Sacramento that whenever anybody passes new legislation about 
schools, they should attach what I call a Pedogogical Impact State- 
ment . It's like an environmental Impact statement except it asks the 
question what impact is this going to have on the work of the teacher 
m the classroom: how much more paperwork, how many more students 
of which kinds with what sorts of trade-offs? A Pedogogical Impact 
b>tdtement will ensure that as you Implement Innovations, you do them 
in <i way that makes schools educative settings for teachers. And 
once they are, I will guarantee that they will have become educative 
for ♦.he pupils and communities they serve as well. 
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' American schot^ha^m not fsuted The ree^sn tor taH<ing about it ^rK^ 
to be defensh^ argumentative, it is to create the corKiittons rwces- 
sary tor organlzatkinal change'* 

' ' y^e need to seek out and irtHMrrmi programs and strategy tha t will 
improve ex(^l}en(^ and e<^jity,&Am have to (k) that ci^fki&it of two 
assumptions: oneisfftat what mdoin schools msk^ a critical differ- 
ence to the lives of children and young adults, arxl secondly that what 
American schools do to affect the lives of children arxi ^3ung ^ults is 
the t^est in the world." 

"Whatteacherslooktorintheseschoolimprovementproiectsis whether 
6 months after ttw pro^t has started, ttm superinterKtent or repre^n- 
tatives of the s u pe r int en d en t' s s taf f ar e stiHarourKi when the implemen- 
tation problems start bear down on individual classrooms and individ- 
ual schools." 
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STRATEGIES FOR EFFECTIVE SCHOOL IMWOVEMENT PROQWMS 

David Clark 
Professor of Education 
Iftdiana Itailverslty 



I want to change the focus from the teaching research that's 
been reported to you over the last 24 hours and talk about sme of 
the things we know about effective school improvement programs. But 
first I too want to reflect on the peculiar situation we find our- 
selves In at the present time. Americans must be both the most self- 
assured and confident and the most unsure and Insecure people on the 
face of the earth. After we've experienced decades of Industrial and 
economic success and virtual unchallenged theoretical and practical 
leadership In the art and science of manageme/it, the emergence of an 
effective International challenge set off shock waves of uncertainty 
anc despair about our ability to manage our businesses and Industries 
anci compete In multi-national markets. 

Happily for us before we were submerged by Theory Z and quality 
circles and simply turned over our industrial enterprise to the 
Japanese, two thoughtful business consultants wrote a best seller 
observing that American companies with exemplary records of success 
in the ro<irketplace still existed. They rediscovered some of the 
elements of genius In America's business and Industrial complex and. 
produced a revival of confidence in American business and industry. 
Later in this talk I will comment more on their findings as they 
apply to schools and school systems. 

The reports that are being issued about education argue that the 
ability of educationists In the 1980s to respond to what we know 
makes a difference In schools will be insufficient. That is, we 
can't do the Job. It's not that we don't know how to do the job, or 
that we don't have the information to do the job. The reports 
portray American schools as organizations that have failed. That 
contention is not true. American schools have not failed. The 
reason for talking about It Is not to be defensive or argumentative. 
It is to create the conditions necessary for organizational change. 
You are the individuals responsible for managing schools and 
providing leadership In schools. If you do not have a sense of 
efficacy about your past efforts, your current efforts and your 
future potential efforts, you have no more chance of succeeding at 
your task than students In the classroom who consistently receive 
negative reinforcement on learning tasks. If you don't believe you 
can change your schools and your school district, if in fact the 
assertions of A Nation at Risk are true. If that report correctly 
portrays the condition of American education, our situation would be 
hopeless because it is a charge against the persons who are currently 
managing our schools. Fortunately it's not true. A Nation at Risk 
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Intent lonaUy engaged In hyperbole to sake the points that the 
authors thought were Important. to bring to our attention. 

The challenges that confront American education are numerous, 
and the demands are going to continue* We need to seek out and 
implement programs and strategies that w1!1 Improve excellence and 
equity. But we have to do that confident of two assumptions: one Is 
that what we do In schools makes a critical difference to the lives 
of children and young adults, and secondly that what American schools 
do to affect the lives of children and young adults Is the best in 
tne world. Ue have to have. a sense of efficacy. 



What Do Ue Know About School Improvement? 

Research on educational change has clarified and specified some 
of the Ingredients necessary for school improvement. As with the 
effective ichool, effective school Improvement programs are probably 
best represented as a "syndrome" or "culture** of mutually reinforcing 
expectations and activities. For the purpose of bringing together 
the research findings of the school improvement literature, let me 
offer a set of propositions— statements for discussion. 



Proposition 1 - Public schools, individual classrooms, and school 
systems can and do improve and the factors 
facilitating school improvement are neither so 
exotic, unusual, or expensive that they are beyond 
the grasp of extraordinary leaders in ordinary 
situations. 

The record of success of school improvement programs whether^- 
they are local school improvement programs, state school improvement 
programs, or federal school improvement programs is very good. The 
federal initiatives worked very well in terms of the amount of money 
that was put into them over the past 15 or 20 years. One of the 
myths being perpetrated is that the evaluations of these programs 
were negative, and that's incorrect. The evaluations of the programs 
were almost uniformly positive. 



Proposition 2 - People matter most in school improvement programs: 

(a) Teachers can and will implement new practices 
and programs given active leadership from 
building and central office administrators, a 
chance for planning the implementation procesSj 
appropriate training, opportunities for inter- 
action, breathing space to try and fail, and 
continuous assistance and support. 
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Tnere dre probablj^ no professionals In all ttuaan existence that 
receive as little positive feedback froo other adults as classroom 
teachers. And during a fwrlod of school Improvefflent It Is terribly 
Important that they be provided with that positive feedback from 
other adults. 

(b) Building level administrators isake a difference 
In school Improveaient programs by establishing a 
clltnate of expectations that teachers will 
successfully Improve practice and by providing 
on-site coordination, communication, assistance, 
and support. 

(c) District level administrators affect school 
Improvement programs by exhibiting active ' 
support In the form of communicated expectations 
for success, psychologltal support, needed 
resources^ and local facilitation assistance. 

I can tell the district level administrator something about the 
nature of that support as viewed by teachers. Teachers suspect the 
district level administrators will provide support during the adop- 
tion stage and then they'll stop. As sqOn as they've convinced 
enough school people to start working on' a project, they'll lose 
interest In It and they'll be off on something else. And what 
teachers look for in these schcfol improvement projects is whether 6 
months after the project has started, the superintendent or repre- 
sentatives of the isuperlntendent's staff are still around when the 
Implementation problems start to bear down on Individual classrooms 
dnd Individual schools. 

(d) External asslsters are most effective at the 
school level providing concrete and practical 
assistance on Implementation Issues, 1.e., plan- 
ning, scheduling, problem -solving, follow -through. 



Proposition 3 - An innovation Is more likely to be adopted and 

Implemented If It Is perceived as having relative 
advantage, compatibility, simplicity, and legitimacy. 
Implementation is more effective when the Innovstlon 
focuses on a specific need and demonstrates clarity 
In purpose and techniques. 



Proposition 4 - Specific resources are necessary to support effective 
school Improvement programs: 

(a) Staff development programs that are task- 
speclflc, and provide on-going, continuous 
assistance anij ^rt. 
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(b) Monetary resources thdt are adequate to provide 
the people aiid time needed In the program. 

The notion that these programs can proceed without external . 
assistance Is belled by all the presentations that have been made 
here. Monetary resources are frequently needed to provide people and 
time needed In the early stages of the Innovation when, for example, 
teachers need to talk to one another. 



lesions From America's Best Run Schools 

Let me turn to a broader literature. Many people at the present 
time are concerned with the nature of effective organizations. 
Tnomas Peters and Robert Waterman unleashed a blocfcbustuf best se;ler 
this year on America's best -run companies. In Search of Excellence. 
Tne book is an articulate and relaxed summary or what the authors 
learned by visiting 35-40 successful co{^pan1es, serving as 
consultants for many years to both successful and unsuccessful firms, 
and reviewing rather carefully contemporary theory and thought about 
organizations. They began their presentation by noting and 
commenting very briefly on attributes they asserted characterized 
excellent companies. 

I want to close by noting seven characteristics of effective 
organizations that I think are also characteristics of effective 
school s. 

1. Co wmltmont. Good schools project a ralson d'etre. The 
scnool's mission that *s asserted by Individual staff 
members may seem Imprecise but collectively the staff has 
arrived at an agreed upon set of behaviors and outcomes tnat 
are sufficiently si^cific to acculturate new organizational 
members and control the behavior of veteran members. They 
are organizations with a sense of themselves. 

2. Expectations. • &)od schools and school systems are populated 
by confident people who expect others to perform to their 
personal level of quality. The attitude of success crosses 
categories and feeds on Itself. Teachers expect students to 
achieve. Students know they are expected to achieve and 
they expect, in turn, to have Involved, competent teachers. 
Principals are surprised by teachers who fail. Teachers are 
surprised by administrators who ask Httle of themselves and 
others. 

L Action. People in good schools do things. They have a bias 
for action, a proclivity for success, and a sense of oppor- 
tunism. They plan for now; seize decision options when they 
arise; try new ideas; drop bad trials; and play within their 
strengths. Good school systems and schools have learned how 
to avoid talking new ideas to death. Critics of the 
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lAStructionaHy Effective Sctimls (lES) movement pointed to 
Its vague Interna) structure. Good schools Invented a 
structure and ImRroved their practice. The alternative 
public schMis movement of the late 70s flourished and 
succeeded because educators In those sites preferred to try 
new possibilities for success rather than live with old 
possibilities that had failed. 

4. Leadership. The I£S literature hammered at the role of the 
principal as a key factor In school effectiveness. The 
School Improvement (SI) research singled out the chief 
school administrator as the key to adoption and her/his 
staff as critical Internal asslsters. They are probably 
both right and Incomplete. Peters and Waterman pressed the 
point that, "Innovative companies foster many leaders and 
many Innovators throughout the organization*" People with 
high levels of efficacy and expectancy who are trying and 
experimenting cannot be restricted to designated leadership 
positions. Effective educational organlzatldns spawn 
primary work groups and Individual "champions" In unusual 
numbers. The designated leaderships create an environment 
for trial and a tolerance for failure so that leaders can 
emerge and be sustained at all levels of tlw school system. 

5. Focus. Good schools pay attention to the task at hand, 
student achievement In the classroom commands the attention 
of teachers and administrators. Vtore classroom time Is 
allotted to academic learning; more of the allotted time Is 
engaged academic learning time for students. Staff develop- 
ment programs concentrate on classroom -oriented skills and 
understandings, tiood schools know what their core tasks are 
and focus on those jobs. Like successful companies they 
"stick to the knitting." 

C 11 mate. At a minimum, good schools maintain an orderly 
and safe environment for students and teachers. But they 
are much more than orderly. Time after time observers 
report that the organizational climate In successful schools 
is obvious but hard to specify. Firstly, successful schools 
work for all the people In the building. They are not 
schools for students; nor are they schools for teachers and 
administrators. They work for adults and children and 
adolescents. The SI literature emphasizes that successful 
innovations have to fit teacher needs. That sounds selfish. 
One is inclined to say who cares about teachers If it works 
for students. The point is you can't have one condition 
without the other. Good schools are good places to live and 
work, for everybody. 

7. Slack. Good schools have a reasonable level of human 

resources and slack time. In the IE5 literature this shows 
up in an increased number of adults to children in the 
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building. In ttm SI literature the linponance of Internal 
and external assisters Is eisphaslzed. Both literatures 
describe the n^essltjf of time for teachers to participate 
In staff development activity and Incorporate new practices 
into their already crowded profes$1<»ia1 lives. Good 
practice Is facilitated hy a reasonai>1e level of orsanlza- 
tlonal ntiuiuUncy and slack at the classroom level. 
Tolerance for failure* encouragement of experimentation, and 
the capacity to Invent and adapt Innovations are not 
achievable In organizational settings Mhere effectiveness is 
regularly traded off for efficiency. 



Oo these attributes strike you as ordinary, even unsurprising? 
Ue lH>pe so. Ordinary conditions would appear to be attainable. Host 
American schools are not excellent. Just ordinary. Imagine that they 
could become ordinarily excellent. 
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' 'We need to think not only about improving ttm curricufum, improving 
the standards, improving our tests, and improving the pedagogical skHls 
of teachers; we also need to think about how we 're organized^} driver 
mstnjction. \Ne just ar&i'torgaff^zedin ways that wiif enable teachers as 
individuais or the staff as a whote to help students in every way possible." 

' ' Take a look at wfiat you assume about the organization of time, because 
with organization of time comes boundarms on opportunity, eligibiHty, 
access, etc. Those conditk>ns are the real determinants ofstixient suc- 
cess." 
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OR&ANIZING AND 0£tlV£RIN& CUHRICULim FOR NAXimiM IMPACT 



Mi 11 lam G. Spady 
Di rector 
Far West Laboratory for 
Educational Research and Oeveloproent 



There's no doubt about 1t» the National Commission report has 
captured the attention of the public, the press, and policymakers 
like no other education document has for a very long time. It has 
led to the creation of at least one commission on educational 
ifflprovement in every state, and it has also been followed by report 
after report after report. But as these other reports came along, 
the thinking, tt» focus, the recommendati(ms in them began to differ 
substantially from the point of view represented in the National 
Commission's report. That is, while everybody wanted excellence, 
they had different conceptions of excellence; and while everybody 
wanted improvement, they had different ideas about what was supposed 
to happen to the curriculum and the kind of instructional delivery 
system that it requires. 

At Far West Laboratory we decided to write a critical synthesis 
of all. these different reports and to develop some bottom line about 
what they really say and which of the many recommendations in them we 
should be paying attention to, based on what we know in the litera- 
ture and the best the.'>ries and practices that are available at the 
present time. In this book. Excellence in Our Schools; Making It 
Happen , we have attempted to synthesize nine reports and formulate 
their recomnendatlons into some kind of concrete plan that local 
districts i'ld states can use to move school improvement efforts 
forward. It is not ray intention to talk you through all of that 
today. But I do want to discuss some of the ideas in these reports 
because they represent some things about the organization of curri- 
culum and the delivery of instruction that may seem pretty radical. 
They open up SMie Issues and some opportunities for the schools that 
are very «j1fferent from just business as usual. It's not a matter 
of just upping the standards and upping the demands and upping the 
requirements. There are some recommendations in these reports that 
have to do with changing the character of schooling and changing the 
basic definition of teaching roles and responsibilities and adminis- 
trator roles and responsibilities quite substantially. I'd like to 
talk about those recommendations and offer some examples of 
strategies used by three school districts that are responding to this 
challenge. We'll look at some of the results they've been getting. 



Four Messages in the Reports on Excellence in Education 

I'd like to begin by summarizing what I feel are four very 
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FIGURE 1 
NINE MAJOR REPORTS 

1. Adier - .The Pal del a Proposal 

2. A Natlof) at Risic 

3. Action for Excellence 

4. Academic Preparation for College 

5. Twentieth Century Fund Task Force 

6. Goodlad - A Stu4y of Schooling 

7. Sizer • A Study of High Schools 
8» fioyer - High School 

9. National Science Foundation Board Report 



general points that are pretty consistent across all of the reports. 
That Is, there are real differences among the reports, but there are 
thematlcally In virtually all of them four very significant things 
that I think represent some major challenges to instructional mana- 
gers. And I'd like to make the argument that Instructional managers 
include everybody from the state superintendent to classroom 
teachers. They are all Instructional managers. Earlier tCKlay Dave 
Berliner focused a great deal In his remarks about the nature of 
decisions that teachers need to make— decisions about time, curri- 
culum, grouping, and allocation of resources In their own classrooms. 
That's all Instructional management (see page 89 )• Principals need 
to make similar kinds of Instructional management decisions within 
the building as a whole. It's a matter of simply looking at what 
your organizational frame of reference Is. 



FIGURE 2 

?om mom instructional management needs 

1. Elevate traditional definitions of literacy and competence to 
include higher -order thinking and application skills , and 
integrate them into the "essential curriculum," 

2. Assure that al 1 students acquire these skills consistent 
with state-of-the-art in Instructional delivery, 

3. Employ models of Instructional delivery that maximize 
instructional time, staff capabilities, aval lable 
technologies, dollars and community resources. 

4. Evaluate and Improve both staff and program effectiveness 
as essential components of an integrated instructional 
management strategy. 
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Now, what are the messages? Kessage nusber one Is %{mp}^ that 
what we have been calling basic skills in the last several years is 
an inadequate conception of basic skills. It doesn't 90 far enough. 
It does not deal with some of the truly essential basics involving 
higher-order thinking skills, analysis, problem solving, etc. So, 
^01% message that tte r^rts all share is that we need to elevate our 
conception of what we «ean by basic skills and change the curriculum 
focus to ensure that this new concepti<H) of the basics is addressed. 
And r« not just talking about the subject matters that constitute 
the basics. We're really talking about the kinds of intellectual 
Skills that are part of those basics. 

Second, there is a demand that virtually all students reach 
those basics. It's not a matter any longer of simply the brightest 
and the best. As 1 read It, the charge to the schools in those 
reports 1$ that all kids need to master the elevated basics. And, 
that's really whST^hls conf^ence is about. What are those ideas, 
those practices, and that research which really tells us what type of 
instructional delivery will make this happen? 

The third major message is that the schools are going to need to 
employ models of instructional delivery that maximize the resources 
they've got. The fact is, when you look across the United States at 
what has happened since the reports have come out, there are on'ly two 
states that have deliberately Increased their funding for education 
despite all the appeals in the reports for greater funding^ 
Fortunately, I think the research tells us we can be doing a far 
better job with some of the resources we've got than we are now 
doing. And the reports are very clear about the need for more 
imaginative, creative use of the resources. We need to try to do 
both- -increase our resource base and make better use of the present 
resource base. 

Fourth, there is a strong message in the reports about the need 
to improve staff and programs through evaluation. We need to be more 
accurate and more rigorous in the evaluation of educational person- 
nel. And we need to be equally rigorous with program results. This 
is a major challenge to building-level administrators to make sure 
that they have the skills and tools to do the evaluation because the 
assumption is: we aren't really going to improve unless good evalua- 
tion is part of the Improvement process. 



Toward a Definition of Excellence 

So, as 1 see it, there are at least four substantial points of 
agreement in the reports. But there is considerable disagreement on 
other factors, and as I looked at the 800 recommendations in those 
nine reports. I asktd, "What is it that ties these together In terms 
of a sense of common mission or common definition?" Everyone was 
arguing for excellence, but a common definition was needed to drive 
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our analysis of the various reports. We chose to use the definition 
of excellence in the Hatlonsl Coiamlsslon's report. A Nation at Risk. 
as the basis for our analysis. 

Let me just remind you of two key components of that definition. 
The first part pertains to excellence In learning: 

'*At the level of the individual learner, excellence 
means performing on the boundary of Individual ability 
in ways that test and push back personal Hinlts." 

it doesnt say excellence Is achieving a 12(W) composite on the -SAT. 
It doesn't say excellence is getting straight A*s in school. It 
doesnt say excellence is getting admitted to Harvard. It says, that 
at the level of . the individual student, excellence occurs when he or 
she is being challenged at the threshold of what th^y can do. That 
is. It's pushing at their current personal limits. 

Number two, excellence for the organization is defined by the 
National Commission as: 

"That school or college which sets high expectations 
and goals for all learners; then tries In every way 
possible to help students reach them." 

It is that part of the definition that is clearly most problematic to 
schools. As I read the definition, and as I thought about the 
different reports, it seemed to me that the reports appeal to educa- 
tors to organize and operate in a way that allows them to help 
students in every way possible. And I'd like to make the argument 
today that we are organized In a way which prevents us from doing 
that! We need to think not only about improving the curriculum. 
Improving our standards, improving our tests, and improving the 
pedagogical skills of teachers; we also need to think about how we're 
organized to deliver Instruction. We just aren't organized in ways 
that win enable teachers as Individuals or the staff as a whole to 
•;elp students In every way possible. 

I took that as a starting point and generated the following 
definUion that I'd like to use as our definition of excellence. 



FIGURE 3 

A W(»iKINti DEFINITION OF EXCELLENCE 

Excellence occurs when the instructional system 
is able to provide the individual learner with an 
appropriate level of challenge and a riaTistic 
opportunity to succeed on a frequent and continual 
basis f^r each Instructional goal in the program. 



" 32 



Notice t»ie words that I've luuSerllned: (1) Instfuctlonal system —we 
need to think of Instruction occurring as a total system, (2) 
Individual } earne r —the bottom line Is the Individual learner, not 
•inoie classes or Khdle grade levels of students, (3) appropriate 
level of chall4gnge — we need opportunities to succeed, and these 
opportunities ft«ed to be fre<)uent and continual. Maybe, In fact, 
the word should be contli^uous. They don't happen on a periodic 
basis; they are present all the time. The final isajor condition In 
the definition Is that tte curriculum and the Instructional orogram 
need to be built around clear goals. We need to know the purposes 
for what we're *)1ng and what we're trying to accomplish. Excellence 
occurs when we can help students succeed In a timely fashion with 
regard to all of the goals which we have for them In our program. 
That's the best we can do, and If we do that, we will Indeed be 
excellent. 



Excellence in Education; Three Examples 

I want to talk about three different school districts where the 
Instructional programs that they use come extremely close to this 
definition of excellence. And I'd like to share with you some of the 
results and successes they've had by pursuing and organizing their 
Instructional programs this way. 

Thf> first district, Johnson City, is a small, blue-collar 
district in the state of New York. Johnson City began a systematic 
school improvement program about 12 years ago based on some of 
Professor Benjamin Bloom's Mastery learning concepts. The lines In 
Figure 4 indicate class averages for first grade through eighth grade 
on the California ^hlevement Test In reading. 

What Impressed me about these data was the following: (1) the 
lines angle upward; that Is, there is a cumulative positive effect 
for students, which means that over time those students are doing 
better and better in relation to grade level norms; (2) the program 
Is Improving In its impact year after year; that Is, there is a 
cumulative benefici^al effect the longer they work at this approach; 
(3) by the time those eighth graders finished school In 1980, the 
class average on the California Achievement Test in reading was close 
to 2-1/2 years above grade level. And these are averages; they 
Include all students at the grade level. These results are very 
impressive, and they are matched by state assessment tests. 

Their math results represent a very similar pattern, but they 
finish even higher (Figure 5). There is some variability between the 
1979 line and the 1980 line, but the basic pattern Is one of very 
high achievement for virtually all graduating eighth graders. 

The next district I'd like to show you Is Red Bank, New Jersey, 
i district with a large number of minority students. I'd like you to 
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focus furtlcuUrly on the 1978 line. It says that In 1978 the longer 
the students stayed In that school district the less they learned 
(Fi9ure 6). That Is, things just got worse and worse and worse. 
Their superintendent. Or. Uoan Abrams said, "These kinds of results 
are an embarrassment. They do not need to exist. These kids can 
learn, and we can make the progran better so that that happens." Two 
years later they had risen to the 1980 line. One year after that 
they had achieved the 1981 line, and two years later the^y had 
achieved the 1983 line. So youVe looking at a gain over a five-year 
period In the average achlevem^t scores of three full years In 
reading. That Is, eighth graders were a year and one half below 
expected norms In 1978, but they're basically a year and one half 
above expected norms by 1983. That happened because of a very 
dedicated commitment to the kind, of definition of excellence that 
we've just provided. , 

The math scores are unbelievable (Figure 7). They show an 
achievement gain over a five-year period for eighth graders of about 
four full years. That Is almost a grade level per year In the 
Improvement of those students over what the previous graduating class 
had accomplished. I have not seen a turnaround situation In any 
school district that matches that. And the Interesting thing to me 
IS that this Is happening In self-contained classrooms with grade 
level groMpIng of ttie students. It shows what can be done when we 
get our Instructional delivery act together, when we organize curric- 
ulum well, and when we give teachers the skills to do better and 
raise their expectations about the capacity of their students to do 
better. This was one of the major barriers In the district, the 
belief that the kids couldn't really handle any more than they 
already were. 



FIGURE 8 

CENTER SCHOOL. NEW CANAAN, CONNECTICUT 
MATH RESULTS 

* About 15% of Sixth Graders finish the first half of 
Algebra I. Some complete It. 

* About 60% of Sixth Graders score 99 percentile on M.A.T. 

* About 30% of Fifth Graders score 99 percentile on M.A.T. 

* About 2 students In the entire school score below grade 
level. 

* Lowest Sixth Grade score > 6.3 
Lowest Fifth Grade score =5.9 




The third nod«1 Is a oiddle class district In New Canaan, 
Connecticut, These results are average results for the last seven 
years (Figure 8). This Is a K-6 school that has 15t of tf^lr 6th 
graders finish the first half of Algebra I each year. In fact, some 
of the^r 6th graders each year ccmiplete Algebra I. About 60 percent 
of their 6th graders every year score at the 99th percentile on the 
Metropolitan Achievement Test, and about 30 percent of their 5th 
graders score at the 9^h percentile on the Metropolitan. Only two 
students or fewer each year In the last seven years have scored below 
grade level for any grade In the school on the Metropolitan, and that 
Includes handicap!^ students. It is an exciting model, and It Is jy 
organizing Instructional delivery In the way they do that they are 
able to get these kinds of results year after ^ear. 

Uhat's fascinating about their delivery program? First, they 
have a clearly defined hlerarciu^ of math skills that has been vali- 
dated (Figure 9}. This hierarchy, which they developed and tested 
themselves over a IS-year period, doesn't match the textbooks. That 
Is, the sequence of math skills that they build Into the textbooks 
does not match the real hierarchy of cognitive prerequisites In math 
learning for their students. Second, they are willing to deliver 
instruction to any student who needs to move forward on that 
hierarchy any time they are ready to move forward. And they do that 
by moving the student to a classroom where that particular level of 
Instruction Is going on for as Icmg as they need to be In that 
classroom. And then they move them to another classroom. On the 
average, one out of every seven students in the school is reassigned 
to a new learning group on any given day. 

Teachers do no recordkeeping. Teachers do no testing. The 
teachers only teach. You know who teaches fractions? The fractions 
specialist in the school is a second grade teacher. She would never 
be teaching fractions If all she could teach was the second grade 
curriculum to second grade kids. But she's the best fractions 
teacher in the school, and anybody who needs to learn fractions goes 
to her and she teaciies fractions. So what we've got is a model where 
the entire staff shares responsibility for the entire student body 
and teacher skills are well used. 

Notice that Red Bank, New Jersey accomplished something almost 
as dramatic with their students in self-contained classrooms just by 
having the teachers themselves do far more rigorous application of 
sikills and attention to the grouping of students. You don't hav« to 
go to this incredibly complex model of delivery to get that kind of 
result. 

So what do those three districts have in common besides this 
definition of excellence? One, a commitment to having virtually all 
of their students reach the clearly defined goals and standards 
(Figure 10). Second, tfwy create the context— the climate context 
and the organizational delivery— for the kids to succeed in reaching 
those goals. That has required some major changes in all three of 
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those systems, changes that Involve people's beliefs and attitudes 
aoout tHeir work and stud e nt capaMH ties as. weU as changes of an 
organizational nature (Figure II). People acquire new skills and use 
new processes. And this Influences changes In procedures and organi- 
zational arrangements. They have to change to support those skills 
being used. 



FIGURE 10 
TWO FUNDAHENTAl FEATURES 

1. Conraltflient to all Students reaching clear standards. 

2, Creating the context ror them to succeed. 

Given the "realities" of educational systems, both imply 
fundamental changes. 

One — Affective & Attltudlnal 
Two -- Organizational & Technical 



Fimi 11 
KEY ELEMENTS IN THE CHANGE PROCESS 



Inhibiting 
Beliefs 
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ole Definition 
Resources 




Organizational 
Structure 



Fower , 
Incentives 



Leadership must accomnodate all four I 



There's nothing magical about this at all. In each of the three 
cases, there were three things present: (1) instruction was guided by 
a clearly defined goal, (2) teaching was clearly directed toward that 
goal, 9f)6 {3} students were explicitly assessed on the goal itself 
(Figure 12). And in all three districts the learning of the stu- 
dents was four or more times greater than would have been predicted 
by their previous learning, by their previous achievements, by their 
IQ, o'- by their socio-economic status. There's an Important message 
there in terms of curriculum organization. It means we need to know 
not only what we are teaching, but also what we want the kids ♦"o be 
able to do. And it means that our testing needs to be deliberately 
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organized to directly reflect that. Testing doesn't necessarily mean 
pencil /paper eierclses. In fact, dont use the word "testing" at 
all. Use the word "assessment." Get away from thinking ahout 
testing because testing leads us to thinking about pencil and paper. 





FIGURE 12 




SUCCESS^IENTEO INSTRUCTIONAL ALIGNMENT 


1. 


State your goals In operational terms. 


2. 


Teach explicitly to those goals. Intending to have 




all students reach them. 


3. 


Explicitly assess the goals. 




"4 to 1" Effective Is Routine 




S. Alan Cohen 




University of San Francisco 



Academic Learning Time is a Key to School Improvement 

Let me give you a slightly different look at Academic Learning 
Time (Figure 13). I'd like you to think about time In two different 
ways: (1) time Is an organizer and (2) time Is a resource. School 
time gives us 1000 hours of potential resource to work with. But how 
we choose to organize that time and divide It up* and how those 
divisions of time dictate conditions of opportunity and e*t1g1b111ty 
for students severely limits the resource usefulness of some of that 
time. 

So think about time as both an organizer and a resource and look 
at the Interplay between the organization of time— class periods, 
scnool days, semesters, school year— versus the amount of time we can 
have available to use Inside of those blocks. In allocated tine 
we've got about lOOC hours. Research tells us that the difference 
between the total amount of time available and the amount of time 
mat we actually have for classroom Instruction Is limited. We give 
away recess, lunch hour, bathroom breaks, etc. So, although we 
started with 1000 hours, the reality 1$ that only a fraction of that 
1s actually gofng to be available for Instructional time. A further 
reality Is that even when teachers do a certain amount of Instruc- 
tion, only a fraction of that amount of time captures the attention 
and interest of students so that It becomes engaged time. 

Let me give you an example of engaged time. Johnny is told to 
solve 20 math problems. So he solves the 20 math problems and gives 
them to the teacher and the teacher says, "Great, solve 20 more while 
the other kids are working on theirs." ftow, does Johnny need more 
engaged time on math problems? Probably not. So simply saying that 
our goal Is to Increase engaged time is to miss the point. It isn't 
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just Increasing engaged time because we can have kids Sf»end lots of 
time on redundant, unnecessary* unproductive activities. The 
challenge is Increasing Academic Learning Time. 

As I view the research. Academic Learning Tine Involves three 
major things (Figure 14). First, the kids are working on a clearly 
defined goal. There is a target there far them to pursue. The 
teacher has given them an orientajtion. Second, the teacher's 
instruction is explicitly directed to that goal. The third element 
is that they are working on that goal at an appropriate level of 
difficulty. For them to be working at an appropriate level of diffi- 
culty means: (1) that they've got the cognitive prerequisites to be 
working on that new thing*, (2) that they can have a high rate of 
success in that new challenge; and (3) that they still have a need to 
reach the goal. 



FIGURE 14 
ACADEMIC LEARNING TIME 

1. Clearly Defined Goal 

2. Explicitly Directed Instruction 

3. Appropriate Level of Difficulty 
a) Have the Prerequisites 

b} High Rate of Success 
c} Need to Reach Goal 

" WINDOW OF OPPORTUNITY " 
Increase the Frequency of Windows, Not their Duration ! 



I see Academic Learning Time as representing a window of 
opportunity. It is the time between the readiness to learn and when 
learning is completed. That is, it's that period of time it really 
takes you to learn something. Once you've got It and It is simply a 
routine thing that you can perform, you'll have a high rate of 
success but you will no longer be at an appropriate level of 
challenge. 

So the window of opportunity represented by Academic Learning 
Time is that amount of time that it takes the individual learner to 
learn the new thing which is his new level of challenge. And once 
he's completed it, he is ready for a new window of opportunity. And, 
if our goal is to expand Academic Learning Time, we must Increase the 
frequency of these windows, not their duration. That is, you try to 
have more and more of these threshold experiences for the kids rather 
than merely have them do things longer. Because an awful lot of the 
"doing them longer" is wasted time. It isn't really Academic 
Learning Time anymore; it's unnecessary reinforcement time, 
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If >ou take this notion of window of opportunity and you look at 
what these schools that we've talked atiout have achieved, then what 
It's telling us about curriculum organization Is the following: we 
have to build curriculum around clearly known prerequisites for new 
learning. That Is, if we don't know what leads students, to that new 
threshold, then ttiy'll flounder around In that Instructional time. 
So curriculum organization needs to take this building on prerequi- 
sites Iftto account. Certain kinds of learning can be prerequisites 
for many other things. It's not just a simple linear step up the 
ladder. The challenge to us Is a challenge of using Instructional 
time better. And using the Instructional time better means being 
able to deliver instruction to the students at a time when It bene- 
fits them. 

As I see It, there 1s^ very direct. Immediate, inter-related 
connection among these fourlthlngs wheQ we talk about time as an 
organizer (Figure 15). Time means access, access means opportunity, 
opportunity means eligibility, eligibility means access, access means 
time, time means opportunity, opportunity means access, etc. So that 
our thinking about Improving instructional delivery has got to be 
thinking that forces us to examine the eligibility conditions and 
opportunity conditions. Have we made It virtually impossible for 
people to succeed by how we have chosen to organize Instruction? 
What if they don't finish right when the semester is over? .What if 
they need a couple cf extra weeks? Well, too bad because that's when 
we grade. 



FIGURE IS 
OPPORTUNITY SYSTEM 




All of these affect: 
1. School Organization 
3. Instructional Delivery 



MJpport unity 



Eligibility 



2. Assignment Structure 
4. Impact of Standards 



So, grading, certification, and time are all tied up in this 
complex set of recommendations. The reports all want us to increase 
standards, they all want us to improve things. But it seems to me 
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that when we Iwk at the Issue this way, it has an Impact on at least 
these four thfngs. School or^anfzatfon, that is, how the school is 
organized depends on the decisions we make about these four things. 
The assignment structure In the school, that Is, who works with whom, 
and for how long. Is determined hy those four things. Instructional 
delivery Is absolutely determined ly those four things, /ted the 
impact which standards will have on students' achievements Is depen- 
dent on those four things, 

I'd like to conclude by having you consider that last point 
(Figure 16). If you're going to raise standards and you don't try to 
do these other six things, the prcAability of Increasing student 
failure and frustration Is extremely real, Vou also need to: (1) 
increase the clarity of your goals so that the students know what it 
is you want them to succeed at, (2) change the organization of the 
curriculum, (3) change opportunities to learn; that Is, have them be 
more frequent, more timely, (4) change the quality of Instrucwon, 
(5) Increase opportuf»it1es for the students to ctemonstrate competence 
other than In a weekly test or a semester's exam, and (6) Increase 
the opportunity for staff communication and collaboration. If these 
six things are not also Included, there is a real danger that raising 
standards in the name of excellence may, in fact, backfire. One of 
the first results that t\appene6 when the state of Florida implemented 
its Minimum Competency Testing requirements several years ago was 
that the dropout rate in Florida's high schools went way up. Raising 
standards pushed kids out of school. The dropout rate In our schools 
right now is already alarmingly high, and one of the reasons is that 
kids are not working at an appropriate level of challenge. In some 
cases It's too easy, and in other cases it's too hard, too demanding 
for what they can do. 



FIGURE 16 

When you raise standards, also increase: 

1. Clarity of Goals 

2. Organization of Curriculum 

3. Opportunities to Learn 

4. Quality of Instruction 

5. Opportunities to Demonstrate Competence 

6. Staff Communication and Collaboration 



So raising standards is tied to these six things. And I 
encourage you as you think about your improvement efforts, as you 
design your programs, as you think about improving teachers' skills 
and administrators' skills, to take a look at how things are 
organized. Take a look at what you assume about the organization of 
time, because with organization of time comes boundaries on 
opportunity, eligibility, access, etc. Those conditions are the real 
determinants of student success. 
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"Teachers' bel^fs that alt chikJren can learn is ttw first half of the edu- 
catifity (^estbn. 7??e seconcf half ^ the teachers' belief that they, t)oth 
individually arKi as a faculty, can mach all children." 



' ' This tHJSiness of testing what is taught can be pHtoried as teeing to 
the test but whether that is bad or not <%?©rKfe or? is being rtma- 
sured and for what purposes. // m want tofir^out what cNldren have 
learned in relation to what they have been taught then there must be an 
overlap' or 'alignment' between the content of instnjction and of tests." 
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A DtLPHl ANALYSIS OF THE INSTRUCTIONALLY EFFtCTIVE SCHOOL 



Dale Nanrit Professor and Chairman 
Departownt of Educational Administration 
Teachers College* Columbia University, New York 

Judith Lawrence* Project Associate 
Local School DevelofHnent Project, Board of Education of 
the City of New York/New York Urban Coalition 

Thii Delphi aulyiia of the "IsatrvetioMlly Effective 
School" (lES) vei desitned firit to staetire the carreot state of 
the art end icieoce of echool-bated teechiag nd leeniing for 
poor childten. Second, it ma teeifoed to dtacribe the policy 
ivplicetiooa of the developseatel lerel for school people, 
districti, ' •tatea, ud the federal goveroBent. After in initial 
round that defined end deliait^ the prohles, teau of expert a in 
each of the cosponent areea of the IIS circulated propoaitional 
inventor iea to the panel aemberahip* Mesbera recorded their 
opiniont eboot each proposition, the confidence level of their 
estimates, and where poasihlt the baaia on vhich thoae judgment a 
had ^ bean reached. Thei e d^ta vere then re**ri /colated ao that 
panel Bcabers had Che opportunity to refine their judgnenta and 
coQSDeot on the developing consensus mni dissensvs* 

ThB members are liated belov. They vera aelected because of 
their expert iae in each of the areas snd becauae they vere at 
lesst favorably disposed to the possibility that instruct ionally 
effective schools* according to our definition, did eziat. The 
selection criteria for Bembers are appropriate given the purpoae 
of neaauring poaitive aspects of school practice. This analyais 
vculd not have been served by documenting again the videspread 
belief that schooling cannot vcrk for poor children. 

The responsibility for the interpretation in this sinsmary 
should rest vitb the authors. The quality of this project ia 
attributable to the hard vork end prodigioua cooperation of the 
panel, and they all express their own judgments in the teen 
reports included bere« While Judy Lawrence and I did vhat ve 
could to facilitate the work of the teams vith drafting and 
tentative enalysifi our judgtseots vere not part of the panel's 
opiniont. But our opinions are e^preased in this summary paper. 

Finally, ve need to note vhat should be obvious. Many of 
the areas and issuea discussed in this suomary ere conplicatedi 
sooe are aubtle, Aany are inadequately eatabliahed empirically 
and quite contentious. The analysis done by each of the teama 
report a expert opinion on theae Asttera. The panel vaa aeldoo 
unaninoua and disagreement undoubtedly extends to the current 
summary, interpretation, and recommendationa. 



This reports the suoMry and recowendations* prepared by the 
principal investigatorp of • project aponsored by the School 
Finence Project of the National Institute of Education* The 
views expressed here are the author *a sole responsibility* 
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The Definition Round 

The lES ihould be defined m§ a fchool that €an uicreate 
ecddenic atbieveaent for it a atudenta irho are from lov inccoe 
backgroundf. It ia unfeaaible to expect that a aehool» by 
itaelft can conpletely eraae the relationahip between low 
achievement and lov incone backgrounda but it ia not unreaaonable 
to expect tone isproveoent for theae children^ Hov vuch ia 
enough if a queition t^at anavered cloae to the achool« Coal 
setting ahould include parenta^ cooiBunitieap achool boarda^ and 
achool officiala and it ahould be informed by a aenae of the new 
poifibilitiea for public achool ing« 

Second^ "^ef fectiveneaa** ahould be meaaured by achievement on 
norm-referenced atandardited teata. The panel clearly rejected 
career or vocational fatea of achool gradtiatea aa a meaaure of 
achool iog aucceaa (for theae purpoaea) and equally clearly 
rejected a achool a reputation or the aatiafaction of adulta 
(teacher a and/or parenta) aa a oeaaure of inatructional 
ef fectiveneaa. Teat acorea accurately meaaure literacy and 
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numeracy especially at the basic level; while ve should all 
aspire to additional achieveoents for all children, those things 
are built on a foundation of basic akilla» 

Can achieveaent be changed by manipulating (a) vithin achool 
variables (b) vithin existing reaourcea? There is evidence that 
that is being done; the panel concluded that working on 
alterable variablea within existing resources was a feaaible and 
correct agenda for public schoola* Thia Delphi inquiry was begun 
to test the notion that there were things within reach of public 
policy makers which could be changed to help kids do better in 
school. The propoaition has been supported in the analysis 
although not with the clarity and weight that had been hoped and 
that ttiay be reached in the future. With respect to money we do 
not doubt that more support for schooling for poor children would 
help and that a lot more money would help a lot* But the 
pii vbpect for that is dim at least in part because people believe 
that schools are not able to help poor children. Poing better 
with what we have should contribute to more adequate support* 
And failing to improve alterable variables within current 
resources has the unfortunate effect of holding another 
generation of poor children hostage to a more generous public« 
Thus, schools should begin moving toward instructional 
effectiveness because in both the short range and the long range> 
everyone will benefit* 

The panel was nearly unanimous in wanting to augment school 
effects with help from non-school resources, especially parents. 
While that is desirable, we believe that the essence of the 
public policy problem lies with children who do not and will not 
have those resources. Current trends indicate that within a few 
years, half the children of the United States will have 
experienced broken homes yet few principals have the audacity to 
tell their PTA's that there is not much the school can do to help 
the children of divorce learn in school. School people ought 
similarly to accept the challenge of effective education for the 
children of poverty. 

The Delphi was organised around a five-part typology which 
IS becoming commonplace (administrative factors, teacher 
variables, pupil evaluation, etc. ). It is important to note that 
the framework was both adequate and has become commonplace. We 
experienced less overlap than expected and with one exception* we 
found no major area that was inadequately configured* The 
typology that was used by this analysis is the same as that used 
by many systems that have tried to bring the l^S into practice. 
That encouraging concur r en ce between sc ient if ic and pract ical 
paradigms is further st reng thened by the large number of major 




*The composition of a school*s student body can be changed 
by school policies and those changes have an effect on 
arhipvement. "Student body ccTmposi t ion" had originally been 
8';hBvimpd under "school climate" but was eventually separated. 



•ttt4iet vhich, iiitfepesd«ntly» Imvc fotmd tkt ttne Mt of 
v*ri«ble« ttsefttl in tttttfjisg tbt lHw fvca ditceimtiag for 
Mdiam, that tort of cosvortoMo !• n ia^rtnt oi^al is ttf 
Mturotioo of 0 CMbaoloty. TIm tull onobor of varioblot 
coineide* with «hot school Uodoro Bood from th« ocholarly 
couunity — a Mt of thiago tone tto^h to fit en a flag. 

Aa part of the daf isitiooal Totnnl, tha panel ma atk^ to 
cttiaate bow sacb aaeb of the factors cootribotcd to 
iaatruetienal cffectiveiiacc. lot aurpriciatlTt taaehor variables 
led the vay but the last place raoking of specific corricttlua 
BStetials case as a surprise. 

Table 2 

Psnelittf Fioal Estiaates of Percent Contributed by Each 
of Six Factors to the Instruct ionslly Effective School 

'Suoasrised by Factfors 



FACTOR 




MEDUN 


SD 


TOTiO. POINTS 


1) Ttscher chars ct eristics 


25 


25 


7.2 


245 


snd behavior 










2) Adninistrstor character- 


24 


25 


14.5 


243 


istics and behavior 










3) Student body conpoaition* 


20 


15 


19.6 


196 


4) School leamidg clisste 


13 


13 


, 6.6 


125 


b) Pupil evslustion procedures 


11 


9 


8.4 


106 


6) CurriculuD materials 


8 


10 


5.4 


75 



&. Rumberi 3 and 4 vere ceparated for most but not all of the 
analyait. Moat of tha lES literature atraaiaa educating all children 
vbo come to the public achool regardleaa of faoily backgrounds But 
thoae featurea can be varied by aooe policy makerap e.gs, achool 
bnerdf drawing attendance linea and where ve needed attention to that 
fort of phenomenon ve noved fron five factors to aixs 



Virtually all of the lES literature puta the role of the 
achool principal firat. The panel placed administrator 
contributiona second but vhen aaked vhich factor vaa moat 
reaaonable aa a focua for ^government action (e.ge. legialation^ 
mandated developrontp uae aa a criterion of eligibility for atate 
and federal funding. adminiatrators vere restored to the top 
of the list. Principals are more politically vulnerable than are 
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the beavi ly-unioniEed faculties of Aaerican ichooU, and 
principalf are officially charged vitb school leadership 
functions; both characteristics make it sensible to concentrate 
public policy on school administrators, at least initially. 

Interaction among the variables may be critical to practice. 
If for example, one puts is place a finely-grained pupil 
schievement measurement system, and those data are used 
inappropriately for teacher personnel eiraluations, teacheri may 
withhold their support for a school-tride improvement effort. 
Must improvement be school-wide? Are teachers or schools a 
better focus for public policy? These is^ortant questions have 
not been clarified by this analysis for the very good reason that 
the data base that we might have synthesited about interaction 
and subMtitutability among the factors as they have been 
experienced in the field simply does not yet exist. 

J Neither is very much known about the instruct ional ly 

effective secondary fchool, at least in comparison to what is 
known about lES elementsry schools.* Efforts at school 
improvement are best concentrated in the early grades because 
younger children have less of a deficit to overcome and because 
success there reduces the necessity of costly efforts at 
retcedifltion later. 1*. is fortuitous that we know more about the 
mure important policy level, elementary schooling. 

The definitional round and its iterations (i.e., circulating 
psrly results with requests for clarification and comment) did 
for the panel about vhat one would hope for in any school system 
contetsplat ing connnitting itself to more instructionally effective 
schooling. The panel agreed that if, was realistic to inquire in 
more detail about schools that were helping poor children achieve 
better despite their poverty. The panel might have but did not 
endorse the conventional visdom about the futility of school 
effects. Second, the panel agreed on a limited set of factors, 
those factors stsyed stable and they illuminated pivotal 
questions of schooling practice. Our inf erpretat ions and 
conclusions about each o:: those areas is discussed next. 

Teacher Characteristics and Behavior 

The results of this part of the analysis support the idea 
that more is known, more reliably, about more detailed kinds of 
behaviors with respect to effective teaching thar any other area 

the lES. Everyone agrees about the importance of 
sdministrative leader sh ip but compared to the specificity of 
knowledge about good classroom practice, leadership prescriptions 



^It is possible, even likely, that many of our findings 
would be quite different for the secondary school, e.g., the 
plsce of the curriculum. Unfortunately, secondary schools have 
not had the sort of results-oriented scrutiny that elementary 
schools hsve had and thus, a Delphi analysis would be premature. 
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•re counsels of global perfection. 

As Berliner-Cmhen point out in their report, ''EBipiricftl 
evidence, common ftense^ and rater judginents all aupport [the 
impoitance of time usage] in the clasiroo©. " That means a heavy 
allocation of time-on-taak to direct instruction in reading and 
math. One. effect of that is aimply to give students a chance to 
learn and, vhere materials are appropriately selected^ to 
succeed* 

The second set of items supported by the group's judgment 
deals with an overlap between what is taught and what is tested* 
Curriculum mapping and test analysis can both contribute to this 
alignment. The effect can be increased where teachers pay 
attpntion to what has been taught and learned in the child's 
previous grade ("prior learning" which is in fact a variable)* 

The panel did not believe that effective teachers would let 
their teaching be shaped by what they like or dislike- While it 
IS probably true that the nKJSt professional teachers are that 
disciplined, it is also probable that other teachers will need to 
have strong reasons to adopt unfamiliar techniques. Those 
reasons have both attitudinal and managerial dimensions. 

Another set of items on which there is strong agreement 
dealt with teacher expectancies about student performance: They 
were to be high but attainable,, modified periodically, and 
positively reinforced. Norm-referenced standards are 

fiuppletnented by other criteria and the cyclical relation between 
If^Afning end its recognition is frequently built in to programmed 
instruction, mastery learning, and computer assisted instruction. 

Several items dealt with the teacher as the ^'manager" of the 
classroom and stressed the importance of teachers holding 
students accountable for assignments, handling problems 
simultaneously, keeping the pace brisk, and monitoring student 
spstwork. One way to summai i»e this is to say that when teachers 
{^ach, children learn, and, up to limits which are not nov often 
x^'n.l*>d the more teachers teach, the more children learn. 

Administrators 

We have already remarked on the psnel ' s departure from the 
c ( nvent 1 ona 1 wisdom in placing administrators second on the list 
of rank-ordered contributors to the lES. However, they were 
first on the list of useful policy targets probably because of a 
belief that the lES has to start somewhere and be maintained 
scnaehow. Administration has always been action at a distance; 
It has its effect on services through regulations, memos, 
Dppratmg routines, ond personnel actions, not directly through 
teaching children. But is is clear that the panel wants to cut 
that distance and get principals much closer to children and much 
d*'*^per into classrooms. 



Ther^ if a strong feeling that the principal has become too 
vuch the buaineis oanager and too little the instructional 
leader. Most oeinbers vere willing to tee the management function 
done less veil* all wanted Administrators to do more curriculum 
development and evaluation^ more teacher supervision, more staff 
development and in general to be far more involved with the 
school's teaching and learning mission than is now the case. 
Vhile that is undoubtedly desirable* we think that there are 
three very real barriers to acting on that advice* First, a 
generation of principals has come into office with a diminished 
grasp of instruction* To succeed^ one must be a credible, that 
is a knowledgeable instructional leader. In the lES, 
administrators do more than preside over the aggregate of what 
teachers are willing to do. Such schools have a very discrete, 
concertrated agenda and they have a clearly defined curriculum as 
haB been docuoented in this analysis. If they are to facilitate 
and guarantee its implementation (two very different but often 
• r! - -l^zy functions), principals must first master the 
content of that curriculum. There are training implications here 
that should involve districts, institutions of higher edumtion, 
and professional associations. 

Second, teacher unions have *'power-equali£ed" at the 
building level and principals will have to struggle to assert or 
reassert an instructional role. Third, one of the chief tools in 
that struggle is exactly what the panel would have principals 

de^einphas ize budget control, personnel management, resource 

allocation, and the administrivia that nonetheless steers 
organizations. We are encouraged that same principals are 
leading lES's and in the "real world*' of the public school. 

Principals of lES's did not have a set of descriptive 
characteristics that are unobtainable. They were thought to be 
optitListic people who solved problems and communicated clearly. 
Tbi-y were thought to be good at structuring teacher rewards (even 
in the face of union contracts that have unnecessarily paralysed 
socte) and they did much more than monitor classroom instruction. 
Thp panel was not impressed with the principal as a community 
rplationfi expert or as a grant getter: neither was a necessary 
c,/rjponpnt of the principal's role. 

ViHiat was necessary was that the principal set high 
sranciards, a practice that would depart from the current, 
pr baMy modal practice in which the principal ''protects the 
tracherfi" from '^unreasonable demands^" Knowing what is 
"reaf;onable** depends on what is possible. Thus, if the faculty 
IS to believe in the possibility of its work, the school's 
leaders must first understand the issues and their potential. 
Schools have been rightly criticized for being adult centered, 
nut child centered. Demanding principals will need political 
nuppurt and courage. The panel helpfully pointed out that a 
«chv;ol focussed on basic skills acquisition would have a more 
rfssf nable »et of goals than the current goal overload and goal 
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Student Body Composition VariAblee 

Student body composition variables caused the nwst 
conceptual trouble for the panel but unless that difficulty is 
overcome, people interested in the lES t&ay miss a source of 
improvement. The problem lay in having to consider the class 
status of some children first as a given that defined the IES» 
but second as a variable, parts of which wight be manipulated to 
children's benefit. The lES may be defined as a school that 
works for poor children but that does not mean that children from 
ether social classes might not also attend such schools. The lES 
definition treats family background as a constant, but that same 
fsctor is a variable for some policy purposes. This part of the 
Delphi looked for contextual effects, "To vhat extent does 
student body composition. . . effect an individual student's 
owl. V cruitruL , Ceteris paribus ? " 

The overall conclusion of this part of the study is 
melancholy. Those factors most" important to achievement are 
hardest to change; those that are easiest to change are least 
important. For example, the panel concurred that there are 
strong effects on achievement for a given child according to the 
dOc .al class of that student's classmates. But school attendance 
lioes cannot be changed by principals. Superintendents, school 
board members, state officials, (and judges) can alter those 
lines and for them the social class composition of a school's 
student body is a policy variable. This finding is one of the 
few exceptions to the school building focus of the group's policy 
i;iipl icat ions. Here the challenge is above the service delivery 
level. Interestingly, the same questions about belief and 
politics will apply for all actors. 

The panel believes that big elementary schools diminish 
achipveroenf (a little), that all girl schools help girls and 
woisen develop mor^ of their potential, and (strongly) that 
homogeneous ability grouping diminishes overall achievement. Of 
tiie three, only the latter is clearly within reach of a school 
pr inc ipal. 

Some parent and f ami ly related factors can become school 
variables. The panel thought there were slight achievement 
^fff*cts from mothers in full-time paid employment and from large 
t I lies with closely spaced children (probably because of a 
: { ition of parenting ^'contact time'*). Kindergarten is common, 
• <mie schools have early childhood programs, a few schools have 
parentins education activities that might contribute to i^chool 
achievement. Strictly speaking, the scarcity of those latter 
practices suggests that they are not within-school effects and 
thus should be excluded from our analysis. Whether that is 
accepted or not, the examples may make the point that some 
student body cotLposition variables can be changed to good effect. 



The college-goicg txpectatioDi of the iMireot9 and children* to 
take a final example* if thought to be related to acbievenent aod 
can be ahaped, in part* by achool proceta« 

In general though, the contextual effect a of atudent body 

compciition are not a sajor part of the ICS* It geta done* if at 

all, in exactly the faahion that ahould be characteriatic ci a 

public achool i#itb vhoever cooea to the door. 

School Learning Cliaate 

The productivity o« any vorkplace will be heavily affected 
by the climate of that place* the vay the vorkera feel about each 
other, their bottet* and the vork itaelf* The firat item on the 
ftchcol climate inatrument aaaerted that in an IES,**The ataff 
(believes) in the educability of mXX tbe atudenta aerved by the 
ftrhooi." Thp panel 'a unaniooua aupport for the proposition vould 
not be echoed in many school! attended by poor children. There* 
teachers find theaaelvea expected to be instructors! 
d iBC ipl mariana* clerks, counselors, and supervisors to large 
groups of children: despite their efforts* many of those 
teachers believe that they are unfairly criticised and poorly 
paid. Confronted vith a aituation they believe to be over 
demanding and under rewarding, many have retreated into a 
custodial definition of their irork and explained that* at least 
to themselves, by referring to the research that purports to ahow 
hov little schools can contribute in the absence of nurturing, 
intact, educating homes* Thus* what teachera believe about the 
educability of poor children critically determines how hard they, 
the teachers will try and through that, how much the children 
will learn. 

Note Bene : How hard it is reasonable for teachers to try is 
directly related to how effective schooling Is at its most 
powerful. This Delphi study tested that power and while we urge 
teachers to believe in the educability of all children we have 
been less successful in massing compelling empirical evidence of 
why ^hey should believe that. The conclusion here is not to give 
up but rather to try harder. The evidence does support 
substantial increases in the efforta invested by achool people. 
The second conclusion is that teachers and administrators are 
right to want to know on what basis they are being asked or 
required to change their practices. We know some good things 
that work, those should be implemented now, but we also need more 
research* 

Teachers' beliefs that all children can learn is the first 
half of the e'ucability question. The second half is the 
teachers' belief that ^hey^ bpth indiv idual ly snd tg £ faculty. 
can tea^h al 1 ch ildren. Again, the panel believes that that sort 
of organizational sense of efficacy is importantly related to 
increased achievement for poor children. It should be noted that 
a prior question has to do with the physical safety of the 
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building which oust be lecured before either the children or the 
ieacher2» can Attend to tcbooling. That this it less of « concern 
than io recent ^^ears is due in no tsall part to the research on 
school violence supported by the Federal government and it^ 
is^pleventation in public schools. 

If a school is to hsve an effect it has to be through ssore 
than the efforts of a single outstanding teacher. Children have 
several teachers over the grades and instruction is supported by 
the interaction of different roles. As one meisber put it, to be 
effective, a school has to be oore than "independent classrooms 
held together by a conmon parking lot.'' The panel strongly 
endorses a shared understanding of the school's purpose and a 
common effort in that direction. The prevailing norm stresses 
the "professional autonomy" of individual teachers in individual 
classrooms. Sixty percent of the panel members supported the 
urc position that some of the autonomy should give way to a closer 
integration of the school's work among all teachers. 

Climate measures ordinarily look at questions of work 
satisfaction. While t^e panel had rejected that as a primary 
Outcome ii.dicator of an lES, it nonetheless stressed "morale," 
"sati isf act ion, " and "cohesiveness" as important facets of the 
lES. The group's eai v agreement about those things masks real 
questions about schools vhere adult satisfaction is adequate and 
achievement is not» as veil as schools vhere the children's 
achievement gains have come at the expense of organizational 
factors such as faculty cohesiveness and principal/staff harmony. 
Coals set and enforced above a school's current performance may 
risk the happy climate of a school, at least in the transition 
truxn less to more effectiveness. 

Much of this is related to leadership in the instruct ional ly 
effective school. The panel endorses collaborative planning and 
part ic ipstory decision making,* both of which are likely to 
facilitate the implementation of the substance of the lES. The 
panel also recommends that «t<''minis trators sacrifice some of their 
business management activities in favor of instructional 
leadership although one wonders what would happen to school 
climate if the principal neglected to forward payroll vouchers on 
t ime. 

The lES is an organ iz at ional phenomenon as wel 1 as an 
individual one. The school-based culture of teaching must hv 
engaged in this work as well as each teacher's individual 
esrimate of the possibilities of the profession. 



♦In the administration data collection, members made the 
p(ir.r that leadership might come frcwn. the teacher ranks in 
alduion to, sometimes instead of, the administrators. 



Pupil Evaluation 



The testing practices of American education are not adequate 
to support an instruct ional ly effective achool* The tvo major 
dimensions o^ testing in an lES are instructional tests, often 
teacher ^ made, and atandardiaed achievement tests. The Delphi 
analysis eaphasieed the importance and contribution of both. 

Norm-referenced, nationally distributed, atandardized 
achievement tests, are often criticised but the panel vaa 
forthright in recommending them as a metric of achievement vithin 
the XES. Assuming that they are reasonably aligned vith the 
curriculum as taught, and assuming that their resulta are used 
appropriately, they provide an element of accountability that ia 
more closely related to vhat children need than are other, more 
diffuse or adult-centered meaaurea such as satiaf action vith the 
school. If the test performance of children could not be 
improved by the vork of school people, then it vould be unfair to 
evaluate schools vith such standards. The uses of test data for 
policy decisions are discussed in the policy section below. At 
this point, ve should note that the panel supports the 
formulation of tests by experta and the use of those test data by 
lay people including school boarda and the general community. 
Moreover, a majority of the panel supports reporting of test data 
broken down by students* social clksa. The position is a 
sensible one. First, the instruct ional ly effective school 
assumes that effect vill be measured and, aa long as the lES ia 
defined vith respect to aocial claas, those data are relevant. 
Second^ reducing the unfortunate interaction betveen lov social 
clasR standing and low school achievement is good public policy. 
Reporting the data by social class allows us to set and modify 
our goals. There is a consistent strain in the panel's 
deliberations to open up '^instructionally effective** achoola to 
«11 children. That recurred here as veil where the scores of all 
children were to be reported but presumably the onea^ used to 
judge the lES vould be those from poor families only. 

One important question vaa not considered by the panel. 
Norm referenced standardized tests are designed to cut the teat 
population at midpoint, half above and half below. New York 
City^ Pittsburgh and Atlanta all enroll aubstantial numbers of 
minority students, all have been using the same test, and all 
have had more than half their tested students above the median 
point for a minimum of two conaecutive years. There are three 
possible conclusions from that. First, aome have concluded that 
some systems are cheating and therefore the resulta are invalid. 
Others have concluded that those systems are getting better and 
shoul^d be congratulated. The third poasible conclusion is that 
the results are valid and the norm rhould be changed. Fragments 
of all three responses can be found in current policy 
discussions. Social scientists frequently comment on the social 
stratification function performed by schools. If the norms are 



raided, Ch€ political coDsequences for the important school 
improvement efforts now underway acroai the country vill be 
severe* 

The group's analysis also c&phasised the use of tests in 
conjunction vith classrooo instruction. In general, the 
recommended prsctice is diagnostic-prescriptiye and geared to 
particu ar units vitbin the curriculum. ComKrcial publishers 
are goo<l s/^urces of tests premised on their curriculum. This 
business of testing what is taught can be pilloried as teaching 
to the test but whether that is bad or not depends on what is 
being measured and for what purposes* If we want to find out 
what children have learned in relation to what they have been 
taught then there must be an "overlap" or "alignment" between the 
content of instruction and of tests. 

Some members of the panel were concerned not to overwhelm 
tne teacher with testing obligations; time spent testing is not 
available for direct instruction. Others were concerned about 
the cost of testing* Even taking those caveats into account t the 
frequency and use of instructional testing would be much greater 
than the current practice of testing at marking periods generally 
for purposes of placing the chijiU in his or her next class. The 
emerging maxim is that IES*s use the data they collect and thus 
the consequences of testing impact both what the child and the 
teacher does next. In that regardi the computer systems 
necessary to support much more finely grained pupil achievement 
evaluation systems already exist and are frequently 
underutilized. The cost to student engaged time is a more 
realistic barrier to more testing than is the cost of collecting, 
analyring, and reporting the data. 

Two final points. The panel split on whether or not testing 
at the level of minimum competency diminished a child's 
fispirstions* The question seems to us to be more relevant to 
adults speculating about children than to children faced with a 
series of transitional, ever increaaing achievement thresholds. 
As with the other factors, the panel endorses goal setting close 
to the child and the local school. 

Curriculum Materir:!** 

The ides of "curriculum" ordinarily includes both product 
snd process, the texts and how they are used. In order to parcel 
cut the analysis, one team had to concentrate narrowly on the 
artifacts that mediate, infons, guide, and perhaps determine 
classroom instruction because those materials are related to 
general expectations about how much of what should be taught, in 
what sequences, at what grade levels. Measuring the power or 
efficacy of existing materials for children from poor families is 
al ao important because ao much money is invested in their 
developtnent and purchase. In New York City, for example, half of 
the State's yearly per pupil textbook allowance in the early 
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grades ii spent on confiuatble b«iic literacy amterialft. 



Of the factors contributing to the lES, the panel 
consistently ranked curriculua materials last. Part of that is 
attributable to the narrovneaa of the definition, soft is due to 
the ireight given other factors, especially teachers. If one of 
the najor properties of an lES is a diagnostic-prescriptive cycle 
roughly akin to Mastery Learning, then why vould not curriculum 
support of the 'teacher aa evaluator and diagnostician' be fairly 
central to the lES? The panel consistently stressed 
relationships and teacher behaviors and just as consistently 
rejected mechanistic, rational, sequential conceptions of the 
IE5* This will disappoint practitioners vho rightly search for 
recipes but the good nevs is that, since the contribution of 
curriculum materials is relatively slight, a majority of the 
panelists believed that the lES could be achieved whether or not 
an individttal scluiol possessed optimal texts and materials. 
Similsrly^ the panel was unimpressed with the effect of alternate 
curricula on grouping for instruction* Even though the basic 
skills acquisition research supports direct (reading) instruction 
to large groups, the panel was indifferent to this part of the 
quest ion. 

The folklore about classroom teaching is split on the extent 
to which texts control teaching. Text adoptions are thought to 
have grave consequences because so many te«ichers plan their 
lessons from the texts* On the other hai.d, it is generally 
believed to be impossible to '^tefxher proof" voy curriculum, that 
18, to detenoine the behavior of teachers by having provided text 
niaterials and other support. The panel too, was divided. 
Although materials were not highly ranked, the best of existing 
Curricula nonetheless do support good instruction and do provide 
some rough outer boundaries for practice. The contribution of 
materials to an lES comes not from by-pas aing the teacher 
directly to the student, but from having affected how teachere 
teach. The revolution in electronic learning is likely to abort 
circuit that route, a proposition that is tested daily in the 
video a/cades of America* But in the absence of public policies 
io the contrary, the effect of the electronic revolution will 
vary by social class. Half the households in the D. S* , the top 
half. Will have home computers by 1990. 

The panel had been asked to respond to the assertion: 

Text and other materials or products necessary to support 
the creation end maintenance of an instruct ional ly effective 
school exist.... There is a basic akills curriculum well 
enough developed to facilitate the acquisition of word 
recognition skills^ basic spelling, number facts, etc. 

The panel's agreement was confident and referenced "Distar," 
**Open Court, and ^Breakthrough to Literacy." Again, the prior 
focus on literacy was not seen as precluding a later emphasis on 
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cOTxpr ehen»ion, vritiog, or other abilities. 

Our ovn perspective supports the e&phssis on the lES as a 
**people , lace*" but puts iDore weight on the near term prospective 
breakthroughs in curriculuxa. All innovations are partly 
technical and partly procedural. The recent hiatory of school 
reform shova more improvement in the process of gaining entry to 
the achool and working with teachers than it doea improvesent in 
the content, aubstance, or product of those changes. Aa the 
mature products of curriculum development efforts more accurately 
reflect the results of basic research on teaching and learning 
that vill change. The factors discussed elsewhere in this 

report aligning texta and inatrucfion» maximizing time-on-task 

and direct instruction, matching teaching styles with learning 

styles, using diagnostic-prescriptive sequences, etc. will 

increasingly be reflected in curriculum materials and to good 
ef feet. 

Policy 

The biggest obstacle to more schools becoming more 
instruct ionally effective has to do with attitudes and beliefs 
about what is possible given the state of the art and science of 
teaching and learning for poor children. Because of that, the 
three most important policy implications from this research are 
as follows. 

First. INSTRULTIONALLY EFFECTIVE SCHOOLS EXIST and can be 
used as an orientation, a benchmark, a set of aspirations and a 
source of practical guidance. Pedagogy has changed and is 
becoming more powerful. Some schools are instruct ional ly 
effective, more can be. 

Second, there is a set of KNOWN FEATURES WHICH PROVIDE 
I'SF.FUL, OPERATIONAL GUIDANCE to practitioners, policy makers a i 
researchers. Practitioners and researchers use knowledge in 
different ways and demand different assurances. Because progress 
toward the lES rests so heavily on what practitioners believe is 
pogfiible, f)\e knowledge base of the lES-^-that is, doing more 

research is unusually important. But ^ while that is going on, 

we should all be clear that there are substantive reasons having 
to do with children's outcomes that make school improvement an 
urgent priority, now. 

Third, INSTRUCTIONALLY EFFECTIVE SCHOOLS CAN BE REALIZED 
WITHIN EXISTING RESOURCES. While more money would be helpful, it 
;s nor necesssry* While more autonomy and discretion especially 
for btjxlding principals would be helpful, it is not necessary. 
Iffiprovenient 8 can and should begin now, with what we already have. 
And the outcomes from those improvements should then translate 
:ntu m<;re resources for needy schools. 



The burden of the policy irtplicAtioDA falls unaniiBOusly and 
emphatically od local education authorities and on the school 
building. Attitudes and beliefs are key to aspirations and 
school administrators are the paramount audience that needs to 
understand the lES. Although the panel would probably dissent 
from our interpretation, ve believe that virtMlly all of the 
prescriptions in every one of the factor areas (e.g., teaching, 
pupil achievement evaluation, etc.) require the leadership and 
involveoect of the school principal. Every point in our analysis 
has issplicaticns for the principal. 

Our ovn sumaiary of the major findings, by policy area, 
f al lows. 

^ I ) Adcir.istrator& need to re-emphasxre instructional 
leavlership probably at the expense of some business management. 

(2) They need to set high, child-centered achievement goals 
and in some locales that vill risk the harmony of the school's 
adult culture.* They vill need courage and political support in 
that. 

(3^^ For instructional leadership to be successful it must be 
credible and that vill require training for practitioners. 

Teac hers 

(4) The knovledge base is best developed here. Teachers 
libMuId be encouraged by the convergence of research on a limited 
hei of process and product factors linked to the efficacy of 
their vork vitb children. 

( ) That ^ onvergence has impl i cat ions for the trad i tional 

auionecy now accorded virtually every teacher in every classroom. 

In the future, professional practice vill have to be selected 
Itim a smaller set. 

(6) Teachers as faculties are the preferred locus of 
icnprevetnent efforts. While the lES has implications for each 
teacher as an individtial, the lES is an effective orRa ni zation 
dealing with children over the course of their school experience. 

(7; The orgsniiat ional characteristics of the lES are its 
task orientation (concentrated nearly exclusively on basic skills 
acquisition until that is securely in pla e) and its high 
fxp^'c t «t ions of staff and students. 



*Clsrk and Lotto dissent from this and arRue the importance 
. ? fit*iff sAfisfaction as a precursor to strident achievement. 
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Stttdent Body Caapoiitiop 



(8) VhiU tht XES by definition enrolls children from poor 
femilicsp aehool boards tboold drev school attendance lines to 
maximise the contribution vfaicb heterogeneous student body 
populations sake to acbievment* 

Fu£U Acbieveaent Testing 

(9) Standardised tests are the best overall measure of the 
lES. They need to be reported by social class, shared videly, 
and used to guide policy* 

(10) Testing linked to instructional units needs to be 
increased in order to maximise the overlap or alignment betveen 
vhat is tsught and what is tested* 

(11) Test dats used to manage instruction compared to test 
r^oi^. aanage instructors (e*g. , ranking less and more 
effective teachers) are tvo sepsrate questions. The former makes 
more difference for realiring the IBS than the latter. 

Curriculum 

(12) Cood materials exist although they are not widely 
recognized. More are being developed but the central finding is 
that schools afid teachers can become instructionally effective 
with a vide variety of materials. 

Finally, for every factor ai^a, and for all policy and 
practical uses, there is a similar message. The state of the art 
and science of teaching and learning for poor children is getting 
better. Because substantial improvements are being increasingly 
documented, there is reason for educators to return to lAat 

brought many of them into the profession in the first place a 

desire to help the most needy children^ 



For further information including the 
team reports and propositional Inventories 
for each of the lES domains, write; 

ERZC/Center for Education Policy Management 
School of Education 
University of Oregon 
Eugene^ Oregon 97603 
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'Many legislatures and school boards are telling principals to be strong, 
programmatic leaders. But the same research from which this pre- 
scription derives also says that effective schools grant maximum 
autonomy to the classroom teacher. How can you be a strong, pro- 
grammatic leader and grant maximum autonomy?" 



' Ai' often we look at classrooms in terms of engaged time and for- 
ge kids may tx working on tasks they can never accomplish. I was 
jn 1 when I looked through old curriculum development texts that 
ha ' :tulated that children should have about a 70 percent success 
r<vt ther words, they should fail 30 percent of the time." 
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l^SUtS FUR SCHOOL IMPROVEMENT 



Steve Bossert 
Depdrtment of Education Administration 
University of Utah 



Perhaps one of the most important roles in creating effective 
schools is that of the school principal. Research has shown that the 
instructional leadership provided b.v the building administrator is a 
ke> ingredient in school improvement. But many principals are unsure 
of the most productive ways of exercising their leadership function. 
Many have turned to the work of the effective school studies- 
research by Wilbur Brookover, Larry Lezotte, the late Ron Edmonds and 
otners--for indications of characteristics of effective schools. 
This body of work has identified the characteristics of successful 
school s. 

buLcessful schools emphasize basic skills. In these schools 
students exhibit high levels of time on task. The-teachers and the 
principals set h: gh expectations for all students. There is a system 
of clear instructional objectives. Student progress is monitored 
frequently to make sure that proper learning environments are created 
and that students are actually attaining the learning objectives. 
Tnere is a positive school and classroom climate, and the schools 
seem to be free from disruption. Also in these schools the old 
max 1 m . "effective school, effective principal," seems to ring true. 

Effective principals are strong, programmatic leaders who know 
tnt-ir teachers' problems and effectively allocate resources to 
improve classroom instruction. These principals set high academic 
standards; they maintain student discipline, frequently visit class- 
rooms, and observe teaching. All this sounds like common sense, yet 
*hen you think about putting these things into practice in your 
schools, you will probably find gaps in the research and practice 
knowledge. The suggestions that come from the effective schools 
research have a lot of problems both in terms of the research 
evidence and the practical' suggestions for improving instruclion in 
schools. 

First, I'd like to discuss some of the problems principals face 
in trying f •) implement effective school strategies. Then, I'd like 
to share with you some of the research that has been going on at Far 
West Laboratory in the Instructional Management Program. Finally. I 
will Identify some strategies that particularly effective principals 
have used to improve their schools. 
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Some PracUcdl Problems for Principals 

Let's go back to some of the characteristics that are claimed to 
typlfjf effective schools. The research says that effective schools 
have high expectations for their students. Ho>« high? Should you set 
expectations at grade levet, above grade level, a little bit below 
grade level? He know that children have different learning needs, 
and in fact, many studies have indicated that by setting academic 
standards too high teachers may actually frustrate many children and 
depress motivation. So there Is a practical problem that teachers 
and administrators face when they are trying to exercise their 
leadership role in setting standards. Unfortunately research and 
practice really set no clear guidelines for how high those expecta- 
tions should be. 

Another characteristic of effective schools is that they seem to 
emphasize the basic skills. Again, a practical problem— how much of 
your school program should be devoted to basic skills Instruction? 
Should it be 50%, 75%, 100%? There is no clear recipe for defining 
the appropriate combination of basic skills and other types of 
activities within a classroom or school. And in fact, there is some 
ev1dence--part1cu]arly in the area of math reasoning--that an over- 
reliance on basic skills instruction especially In simple numeracy 
Skills, actually depresses math reasoning. Some of the latest work 
in cognitive psychology points out that higher-order cognitive skill 
training can go hand in hand with basic numeracy instruction. I 
tfimk there Is a challenge here for principals and teachers in 
tninking about the instructional system: what balance of basic 
Skills and higher-order cognitive skills do you really need? 

Une of the problems in the effective schools research that many 
principals have expressed to me is a notion that the research pre- 
sents a dilemma. Many legislatures and school boards are telling 
principals to be strong, programmatic leaders. But the same research 
from which this prescription derives also says that effective schools 
grdit maximum autonomy to the classroom teacher. How can you be a 
strong, programmatic leader and grant maximum autonomy? Clearly there 
IS a balance that needs to be worked out. Many principals that I 
have been working with have agreed that they should be in the class- 
rooms frequently. Yet they have problems with how to exercise 
instructional leadership when they have a highly professionalized 
staff. 

My point nere is that the research and practice base for effec- 
tive schools has not yet provided a solid set of prescriptions for 
school improvement. In fact, there are too many practical problems 
left unanswered, and I think it is a challenge for you as educators 
to try to deal with these and not to accept the recommendations that 
come out of the effective schools research as prescriptions or 

rtr-f ipes for your SCflQOls. 
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The Hesearch Contribution: Profiles of Effective Principals 

During the last three years at Far West Lab, my colleagues and 1 
in the Instructional Management Program have been trying to attach 
some answers to those questions. We are far from getting to a place 
nhere there are distinct prescriptions. But, what I'd like to share 
with you today are some of the aspects of effective instructional 
leadership that have derived from our studies of nearly 20 successful 
principals from urban» suburban and rural districts throughout the 
Western States. 

First, we found that there was no single formula for the effec- 
tive principal. In fact, the men and women we studied used very 
unique and often quite varied techniques for exercising their leader- 
ship within the school. There are very Important contextual factors 
such as the composition of the teaching staff, the student body, the 
community, the district situation, state mandates and the principal's 
own past experience that seem to shape how the principals accomplish 
their role (Figure 1). 

I'd like to share with you a couple of the models that were 
generated from tf-e research that we've done with these principals, 
Tne way we have worked with principals has been to engage them as 
collaborators In field research. We use a process of shadowing In 
which principals are followed by research interns, and their behavior 
IS described. Then through a reflective interview process that 
occurs over several weeks, and in some cases ovei an entire school 
year. Me develop models that represent the principals' behavior. The 
principals like this because many of them have few opportunities to 
reflect on their own behavior and appreciate having a non-evaluative 
"t/dir of eyes" feeding back information about their activities. 

The principal in Figure 2 represents the master teacher mode. 
In ms instructional management role, he spent more than half of 
every day in classrooms working with teachers and pupils in demon- 
str<jtion lessons. He had a very large elementary school, around 860 
students. The school is in a suburban community that" has a v»;ry low 
socio-economic Status and nearly half the teachers were new teachers. 
Hf had an assistant principal and was able to rearrange his schedule 
in Such a way that he could spend a large proportion of his time in 
ddssrooms. He had a clear conception of the direction he wanted to 
attain In the school and created an Instructional management sy::tem 
thdt routinely involved issues of planning, monitoring student per- 
formance, staff evaluation, staffing, and involving the staff in the 
personal and learning needs of the students. One thing that was 
fascinating about this principal --and you can see it In the diagram-- 
IS tnat he didn't separate the notion of school climate from the 
instructional organization within the school. In other words, when- 
ever he tried to change a climate dimension, for example students' 
perceptions of themselves or aspirations, he always followed it up 
with d change in the instructional system. He was convinced that if 
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jfou raised expectations but didn't pro¥ide the opportunity for 
children to demonstrate and practice skills that Mould allow them to 
attain those expectations, their motivations would go down. This 
would lead to a deaK>ra11zed staff and a deffloralized student body. Sq 
he always linked changes in the school climate to change within the 
classrooms In the school. This principal had clear objectives. 
When we looked at test scores In the scIhk>1, (^splte the low socio- 
economic climate and despite a high turnover rate within the com- 
munity, the children had rising test scores In reading and math. So 
it is a very successful school and a very successful principal, held 
in high esteem by colleagues and by teachers* This principal, in my 
mind, exemplifies the Ideal characteristics that come out of 'the 
effective schools research. 

Let's examine another principal {Figure 3). This principal 
spent very little time In the classroom. We characterized his 
management behavior as primarily indirect. He operated his school by 
planting an idea with the appropriate teacher and nurturing that idea 
and watching it spread throughout the school. He had a five year 
plan to improve instruction, but in the six months that we observed 
him, he spent a total of an hour and a half doing practice lessons 
with teachers. He does not follow the clinical supervisor model at 
all. Another interesting characteristic of this principal was that 
this man felt that the school climate had to be put In order first, 
that kids had to be involved in a learning environment school -wide 
that emphasized achievement, personal merit and self direction. He 
also felt that the safety of the school was important. Again this is 
a reasonably large, suburban, elementary school with about 740 
cftildren, situated in a depressed economic area. The school itself 
was in a state of disrepair because of lack of funding. The 
principal felt that the image of the school had to be promoted by 
creating a safe and nurturing environment for the children, and only 
then could he start to make changes in the instructional organization 
of the school. 

These are examples of two different leadership techniques in 
almost identical schools with students from similar backgrounds. And 
both schools are equally successful. What made the difference? 
well, one key difference in these two schools was that the principal 
in Figure 3 had no teachers with less than five years of experience. 
He had a staff which had been at ther school over 10 years. The first 
principal (Figure 2), who was the master teacher, had more than half 
of his staff as new teachers that year. This makes a very different 
context for the exercise of instructional leadership. And instruc- 
tional leadership behavior is contingent upon the context in which the 
principal operates. We followed this principal (Figure 3) informally 
the next year to a new school that had about half the staff as new 
teachers. He then began over the course of the year to look more 
like the principal in 'igure 2. In other words, he had to do much 
more clinical supervision. He couldn't rely on planting a seed with a 
key teacher and having it diffuse throughout the school. 
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Ins^tructlonal Leadership Strategies of Effective Principals 



Although different schools seem to require different leadership 
techniques, we did find some strong commonalities among the princi- 
pals that we've stud1ed« For example, we found that these successful 
principals were very active in their schools. The observers who were 
the shadows for these principals almost had to wear track shoes to 
keep up with the principals as they moved throughout the school. 
They were highly visible. A very common technique that these princi- 
pals used Involved getting in touch with kids as they entered the 
building. For example, the principals commonly met the school buses, 
and as the kids would come off the bus or as they would walk in the 
school, they would look at their faces. It was surprising how often 
the principal could anticipate problems within the school on the 
basis of how the kids came into school. 

Another thing about these principals was that they were very 
systematic in their behavior and systematic about moving through the 
school. As we cataloged their behavior, every one of these suc- 
cessful principals visited every subsetting within the school — 
library, hallways, recess, lunch—every day or every two days. In 
fact one of our principals was so systematic that he had a little 
matrix of his school on a three by five card. He checked it off as 
he touched base with different people. 

These are two key aspects Of their instructional leadership 
role, but perhaps the most striking characteristic of these success- 
ful principals was their conception of instruction. All of them had 
a clear conception of effective instruction, and this conception 
guided their decisions throughout the day and throughout the year. 
Every decision, policy, practice within their schools was linked to 
improving the learning opportunities of children. They were truly 
concerned with quality instruction, and it was manifested in even the 
mundane tasks that principals engage in— from scheduling school 
assemblies, to collecting milk money, to dealing with disruptive 
students. These principals always ask themselves, "How will my 
decision affect the children?" We found that less effective princi- 
pals often ask this same question. But the truly effective 
principals— the most successful ones that we've observed— could 
describe their strategies and actions in terms of solid principles of 
good instruction. They could tie it back to key features of effec- 
tive instructional practice. 

In our interviews and observations of these principals, we found 
that their models of good Instruction are really quite consistent 
with the work that's beginning to emerge from the last five years of 
effective teaching research. Although the principals did not use 
these terms, they seemed to describe the instructional system in 
their schools along the six dimensions or six factors that are seen 
as important for constructing an instructional program at the class- 
room level and at the school level. One of the most important is 
ttme on task. These principals understood the conception of time on 
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task. Time siraply didn't mean allocating time for instruction. It 
meant making sure tnat kids were engaged In the Instructional 
activity and that they were successful at the instructional activity. 
All too often we look at classrooms in terms of engaged time and 
forget the kids may be working on tasks they can never accomplish. I 
was amazed when I looked through old curriculum development texts, 
even some of those written within the lasi: five years, that have 
postulated that children should tuve about a 70% success rate. In 
other words, on their worksheets, tests, and the like, they should 
fail about 30X of the time. But there is a growing amount of 
evidence that success rates around 90% to 95% are the best. They 
move kids ahead rapidly. So, time on task is not simply a matter of 
getting enough time; it's using it in quality manner. 

CUss size and composition are important factors. Most of you 
probably are aware that class size alone is not a good predictor of 
student achievement. But these principals use size in various ways 
to construct classrooms that were appropriate to given activities and 
given tasks. At the elementary level the difference between 25 and 
28 children in ^ classroom probably would not make a big achievement 
difference. It may help teachers to overcome some behavior problems, 
but it probably will not have a demonstrated effect on student 
achievement. However, for particular aspects of instruction and for 
children with particular reading or mathematics problems, smaller 
groups are appropriate. In the successful schools we saw a lot of 
cross-grade, flexible grouping for particular instructional 
objectives. The teachers were Important in constructing this, but 
the principals in these schools played a key role in monitoring the 
Curriculum and making sure that the experiences were high quality and 
well -articulated with the overall goals of the school. In othfK* 
words, the instructional leadership role of the principal was to tie 
the different groupings together. Grouping practices within the 
school seemed very important— from tracking at the high school level 
to In class grouping at the elementary level. The principals were 
invulved in helping teachers develop strategies for effective group 
management. 

There seems to be a growing sense in education today that the 
techniques of direct Instruction, whole class teaching, or active 
teaching are better for teaching the basic skills than small group 
instruction. Well, that may be true. But we found that an overuse 
of direct instruction in the classroom seems to depress higher-order 
cognitive skills. All the successful principals that we've encoun- 
tered are grappling with the problem of how to provide good solid 
basic skills instruction and also provide opportunities for children 
to acquire these higher order cognitive skills. 

In addition to grouping, another characteristic, the activity or 
tdsit structure within the school, seems to be an Important realm for 
yocj instructional leadership. Often times in the elementary level, 
ftner\ teachers work within grade teams, the overall structure of the 
Curriculum within the school can get lost. Let me give you an 
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example. A number of years ago, I was working witn'a school that had 
as a primary goal the creation of self -directed learners. They 
wanted the children who left In 6th grade to have some skills that 
would allow then to enter the curriculum of a junior high, make good 
decisions and be self -motivated and self -directed learners. But the 
junior high school teachers c<»)pla1ned that the students from that 
school were really very dependent learsers* We analyied the Instruc- 
tional program in the school and found that each grade level had very 
good Instructional materials. We also found tha^ in kindergarten 
through the end of third grade the students experienced a lot of 
choice in their Instructional activities. Ihey often chose the time 
in which to work certain activities and had the responsibility to get 
their materials completed. By fifth and sixth grade* the teachers 
were primarily using worksheets and siraple cognitive tasks, recita- 
tion and the like. The students had almost no chance to exercise the 
self -directed learning skills that they picked up in the early 
grades. The principal would be the key person in this school to help 
articulate the curriculum and the schc^T goals across all grade 
level We found this to be true In the twenty successful schools 
that we've been studying. These principals played the key role In 
the articulation of the curriculum and linking the school -wide objec- 
tives to the particular learning experiences that children have In 
those schools. 

These successful principals also were concerned with other 
factors that typify effective instruction— things like the pacing and 
sequencing of instruction within the classroom. At the elementary 
level, the number of new words per day introduced in the reading 
lesson can vary from 1.8 new words a day to 5.6 new words a day. In 
correlating the achievement gains of the children, there seems to be 
some evidence that children Mho encounter 5.6 new words a day achieve 
at a much higher rate. Their achievement gains are significantly 
higher than children who receive only 1,8 new words a day. The more 
exposure, the better. Looking back to time on task, there is good 
evidence to indicate that as you increase time on task you also have 
to increase material density or kids get bored. 

Many teachers and principals don't realize the intertwining of 
different effects in the instructional system within the school. The 
effective principals that we've been studying, as well as the effec- 
tive teachers that we've worked with over the last five or six years, 
seem to understand how these different factors intertwine to shape 
the instructional system. And these successful principals have 
played an active role in facilitating good learning opportunities 
along these dimensions. 

The last dimension that seems to be of central connrn to these 
instructional leaders is the evaluation system within the school. 
One of the key features of good instruction seems to be prompt feed- 
back to students. And, all too often as we've observed in many 
classrooms, the quality of materials is good, the quality of inter- 
action between teacher and pupils is good, but when homework is 




assigned or when class assignments are given, there Is often too big 
of a lag between t»ie feedback the children get and their actual 
performance on the task. What we've found In looking at these sue- 
cessful principals 1$ that many of them have created school -wide 
standards for evaluation. For example, in several of the schools 
there is a school -wide homework policy. Part of that policy mandates 
timely feedback to students, and the principal Is actively engaged in 
momtoring the quality as well as the timeliness of teachers* 
responses to students. At the secondary level, the principal's 
instructional leadership pole may be In monitoring department chair- 
men who are actively Involved in the evaluation -system within their 
department. But in all cases we've found that the principals have 
been active in establishing clear standards for the evaluation of 
teachers and pupils. 

When 1 Mork with principals in groups of 25 to 50 we" often spend 
a half day to a day talking about the instructional systems in their 
schools and developing profiles like the two I have shared with you. 
Principals often don't have the opportunity to reflect on their 
instructional leadership roles in the school and the various factors 
that shape what they can do and how they can accomplish their goals. 
We've just begun to work with a number of principals In Sacramento 
and in Salt Lake City to teach shadowing and reflective Interview 
techniques so that peers can observe each other. Interview each other 
and help construct their own models that help for school Improvement. 
We find this is a useful staff development task. 



Summa r^ 

I'd like to summarize a couple of issues. In our study of 
effective principals we find that there Is no single way for a prin- 
cipal to exercise Instructional leadership. Everyone cannot be a 
master teacher, and not every school should have a high amount of 
clinical supervision. Sometimes it's not possible and many times 
U s not desirable, depending on the type of student body and the 
type of staffing characteristics. 

But it is clear that successful principals have a solid concep- 
t?on of good instruction and that their conception revolves around 
the six or seven key features of instruction that I talked about: 
time on task, class size and composition characteristics, the task 
and activity structures in school, curriculum pacing and sequencing, 
and evaluation. These are key factors that all of these principals 
nave addressed in terms of their general school -wide programs. 

The other striking thing about these principals is that they use 
very mundane actions as the opportunity to express their instruc- 
tional goals and foster excellence within their school. So if there 
IS a punchline for my talk today. It's something like this: Instruc- 
tional leadership does not necessarily mean doing something new, but 
perhaps it means doing things in a new way. Most of you have the 
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elements of effective schools already present In your schools, and 
Instructional leadership, then means knowing how to put them together 
i to a school -wide program that ensures positive learning experiences 
for all children. 
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' 'It IS clear from the research that we have /)een <^)mg that ttw principal 
is important that (afferent chan^ facilitator stytes can be kient^atKi 
descriPed, and that the day-to^ay t>ehaviors of principals can be sorted 
in terms oftho^ that af^j^r to be more useful arxih^M in imfMir^ 
tatton. It also is clear that the principal shwid not be (xxisidered in isola- 
tion from his or her colleagues and otfwr aspects of the school setting/ * 

On any single dimension one particular style may look good. However, 
if the criterion for success is shifted then another style may seem to be 
more appropriate. The implication for all of us that are involved in 
research, evaluation, training, policy development and the monitoring 
of implementation is that the criterbn for success that is being cor> 
^idered must be carefully thought out. Further, no one style is likely to be 
perfect for all situations." 
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THREE PRINCIPAL STYLES UF FACILITATING SCHOOL IMPROVEMENT* 

Gene E. Hall 
Program Director 
Research and Development Center for Teacher Education 
The University of Texas at Austin 



In the last several years as national, regional and local 
attention has Increasingly focused on school improvement, and school 
effectiveness, the principal has once again become the center of 
attention. National commissions, superintendents, school boards and 
othf^rs are charging principals with responsibility and accountability 
for improvement and increased effectiveness within their schools. 

At the same time, policymakers and researchers are again 
examining the leadership characteristics of principals. There. has 
been an enormous amount of effort put Into studying the role of the 
principal especially In the elementary schools. For thirty years now 
the research has emphasized that the principal Is important. The 
various ways that principals spend their time have been described and 
their theoretical models have been developed to describe the 
different leadership styles that principals and other leaders can 
use. fet, the detail of what principals should do on a day-to-day 
basis as they facilitate Implementation has not been as clearly 
speci f ied. 

In recent studies at the Research and L^velopment Center for 
Teacher Education, the details of the principal's role In facilita- 
ting school improvement has been studied. A series of studies have 
been conducted in which the principal's "Change Facilitating Style" 
nas been examined. The particular change facilitating styles being 
studied were derived fro"! earlier research on implementation of 
innovdtions at the classroom level. That Is, these descriptions of 
principal style have not come from theory, but rather from observa- 
tion of principal practice and the consequent effects that their 
prdctice has nad upon implementation at the classroom level. 

In this presentation three differient Change Facilitator Styles, 
Responder. Manager and Initiator, that have been the subject of study 
by staff of the R&D Center for Teacher Education are described. The 
related research is briefly abstracted and Implications of these 
three chdnge facilitator styles for principal training, the planning 

*^ The research described was conducted under contract with the 
National Institute of Education. The opinions expressed are those of 
the author and do not necessarily reflect the position or policy of 
the Natior.d) Institute of Education. No endorsement by the National 
Institute of Education should be inferred. 
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of implementatlofl efforts and the RionUorlng of school 1 {nprovement 
and school effectiveness efforts are discussed. 



The Principal as Change Facilitator 

That principals make a difference in the functioning of schools 
seems fairly obvious. The traditional research and theory building 
around leadership, leadership styles, educational administration, 
change and industrial psychology have suggested overall strategies 
and conceptual frameworks that could be used to analyze the role and 
functioning of the principal. Hov^ever, the extensive research and 
literature that is available has been slow in identifying specific 
behaviors that principals can do that will make a difference. More 
recently research findings from the school effectiveness studies have 
included descriptions of behaviors of principals that were found in 
the more effective schools (Edmonds, 1979; Leithwood & Montgomery, 
1982). 

The research that is described here focused upon the role of the 
principal in a very specif ic. context, that of facilitating teachers' 
use of new instructional programs. Rather than attempting to look at 
the broad irr^y of activities and roles of the principal, the 
emphasis was placed specifically upon what principals do in relation 
to curriculum implementation. Thus, it has been possible to con- 
ceptualize more clearly what is meant about style, by relating it 
specifically to change facilitation and further, it has been possible 
to distinguish between an overall gestalt of a principal's style 
(Rutherford, Hord, Holing & Hall, 1983) and individual behaviors that 
a principal takes from moment to moment in relation to implementa- 
tion. These differences in assumptions and framework have resulted 
in a set of research studies and findings that clearly have implica- 
tion for practice, training, planning future implementation efforts 
and future research studies. 

The change facilitating styles that are described in more detail 
Delow were initially derived out of secondary analysis of an imple- 
fflfntation effort that encompassed eighty elementary schools in one 
large suburban school district. The Innovation was a revised science 
curriculum that was being implemented by teachers in grades 3-6. The 
district had provided the same level of inservice, material support 
and consultation to teachers as they were involved in implementation. 

In the study that was being conducted at that time, teachers' 
■^tayes of Concern about the innovation and their Level of Use of the 
science materials were systematically assessed in twenty study 
schools. One clear finding from that study was that in some schools 
implementation moved more easily with more refined uSe of the science 
program than had occurred in other schools. These schools appeared 
to be similar in terms of demographics, financial resources, and the 
outside staff development support that had been available. The only 
iifference that could be systematically identified between the 
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schools had to do with characteristics of the principal and what the 
principals had done In relation to facilitating their teachers* use 
of the revised science curriculum. 

A secondary analysis of these data (Hall, Hord & Griffin, 1980). 
led to the hypothesis that the degree of Implementation varied In 
each of these schools based tiiion the concerns and Intervention 
behaviors of the sch<>or principals. Further, It was hypothesized 
that there were apparent patterns of behaviors that each of the 
principals used that could be sumniarlzed and appeared to be stereo- 
typic of particular styles. 

in two subsequent studies these emerging change facilitator 
styles became the focus of study. The outcomes have Included clarl- 
ficdtlon of these three change facilitator styles, more detailed 
descriptions of them and. development of a related conceptual fraroe- 
woric about the role of the principal In facilitating implementation. 

The paragraph definitions for each of these change facilitator 
styles are included as Figure 1. It should be noted that other 
styles clearly exist* These three, Responder, Manager and Initiator, 
have been the focus of concentrated study. Hiess change facilitating 
styles have been observed In principals Mho are working in schools 
that were considered to be successful and where Implementation has 
occurred. It is quite likely that in schools where Implementation 
hdd failed or had been drastically altered from the desired course 
that other -principal styles would be found. One can also imagine 
several other styles that principals could employ. 

Clearly any one principal could lie on a continuum from being 
more of d Responder, to more of a Manager, to more of an Initiator, 
At the extreme ends other styles could be imagined including the 
despot and a laissez-faire style. Many principals will not represent 
pure styles, but some principals do appear to follow fairly closely 
tne different styles described in Figure 1. Some of these principals 
were selected to assist in the third principal study. What is being 
Suggested here is three different change facilitator styles that 
principals may represent to a more or less degree. 



The Principal -Teacher Interaction Study 

In the most recent study of principal change 'acilitator style, 
ntne elementary school principals in three different school districts 
<ind their staffs were selected for study. These principals and their 
•staffs were Involved in Implementation of curriculum innovations, 
hach school district was in a different year of implementation. The 
thrjfe schools In one school district were Involved In their first 
year of implementation of a writing curriculum The second school 
dK>trict was involved In the second year of Implementation of a 
unified math curriculum- The third school district was In the third 
yedr of district-wide implementation of a revised science curriculum. 
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FIGURE 1 V 
OESCRlPTIOfiS THREE CHANGE FACIIITAT(^ STyiE^ 

Initiators have clear, decisive long-range policies and goals that 
transcend but Inclu^ Implefflefttation of the current innovation. They 
tend to have very strong beliefs about what ^oo4 schools and teaching 
should be like and work Intensely to attain this vision. Decisions are 
made in relation to their goals for the school and In terms of what they 
believe to be best for students, which Is based on current knowledge of 
classroom practice. Initiators have strong expectations for students, 
teachers and themselves. They convey and monitor these expectations 
tnrough frequent con*'acts with teachers and clear explication of hOM the 
school is to Operate and how teachers are to teach. When they feel It 
is in the best Interest of their school, particularly the students. 
Initiators will seek changes In district programs ur policies or they 
will reinterpret them to suit the needs of the school. Initiators will 
be adflmant but not unkind, they solicit Input from staff and then deci- 
sions are made in terms of tne goals of the school^ even If some are 
ruffled by their directness and high expectations. 

Managers represent a broader range of behaviors. They ^enionstrate both 
responsive behaviors In answer to situations or people atjd they also 
Initiate" actions in support cf the charge effort. The varvations in 
their behavior seem to be linked to their rapport with teachjs<;s and 
central office staff as well as how well they underst4nd and birjt into a 
particular change effort. Managers work without fanfare to provil 
basic support to facilitate teachers' use of an Innovation, They ke^ 
teachers informed about decisions and are sensitive to teacher needs, \ 
Tney will defend their teachers from what are perceived as excessive \ 
demands. When they learn that the central office wants something to 
hdppen in their school they then become very Involved with their 
teachers In making It happen, fet, they do not typically Initiate 
attempts to move beyond the basics of what Is Imposed. 

HHb, pondrrs place heavy emphasis on allowing teachers and others the 
opportunity to take the lead. They believe their primary role Is to 
maintain a smooth running school by focusing on traditional admlnls- 
trail ve tasks, keeping teachers content and treating students well. 
They view teachers as strong professionals who are able to carry out 
tr^eir instructional ro'e with little guidance. Responders emphasize the 
personal side of their relationships with teachers and others. Before 
tf>ey maHe decisions they often give everyone an opportunity to have 
input so as to weigh their feelings or to allow others to make the 
ji^f^ision, A related characteristic is the tendency toward making deci- 
'>u)ns in terms of immediate ci rcumstancgs rather than in terms of longer 
rdfHjp instructional or school goals. Thfs seems to be due in part to 
their desire to please others and in part to their more limited vision 
of now thetr school and staff should change in the future. 

Hd 1 I , ti.E.» Rutherford, W.L., Hordt S.M. & Hu 1 i ng, L.L. The pri nci pa I 

a:> facilitator of school improvement: Findings from recent research. 
Paper submitted to Educational Le-:idersh>p , September 1983, 
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In each district principals were asked to participate based on 
their overall change faclHtating style. Using researcher supplied 
descriptions, key central office administrators made recommendations 
for principals and schools to Involved In the study. Then the 
principal and their teachers were approached to see If they would be 
willing to allow the researchers to <kK:ument the Interventions that 
principals made and to document implementation at the classroom level 
as it was orcurring. 

Again It should be emphasized that all schools and principals 
were seen as being successful by their districts. The emphasis here 
was upon examining the different change facilitating roles that 
principals can take and to develop concrete descriptions of the day- 
to-day behaviors that made up that role. The final Objective was to 
relate these styles to implementation success as it was defined In 
terms of teachers* use of the new curriculum. Schools or principals 
that were In "trouble" were not considered. Schools that were In 
danger of having unsuccessful Implementations were not considered. 
This was an effort to Identify and study varying degrees of success, 
Tdther than the all too familiar case studies of Implementation 
♦"li 1 ure. 

Unce agreement had been reached with the principal and the 
teachers for participation in the study, the principals received 
brief orientation and tra1n1r._, in how to document the interven^tions 
mat they were making. The Intervention documentation procedures 
that tne principals used were developed out of an earlier field study 
(tariff in, Goldstein S Hall, 1981). Principals were then Interviewed 
of> sU'^ at four different points during the school year and through 
bi-weekly telephone calls in which they nominate the various Inter- 
vent >ons that they had made. All of these interviews were audio 
tjpe-recorded. Subsequently the research staff used a special form 
to descrioe the different interventions and code the parts of each 
intervention that was identified. 

The data analyses were based upon two intervention analysis 
frameworks that had been developed in previous research. These were 
the Intervention Taxonomy (Hall, Zigarmi & Herd, 1979; Hall & Hord» 
1983) within which the various levels of Interventions are identi- 
fied. These levels vary from incident to tactic to strategy to game 
plan component to game plan and policy level interventions. The other 
analysis framework was the Intervention Anatomy framework (Hord, Hall 
4 Zi'jaraii, 1980). With this framework the internal parts of inter- 
vpntions v»ere coded, iach principal intervention was encoded in 
tnrms of source, target, function, location, medium, flow and 
'jiration. wun these data it was then possible to do a series of 
systematic, quantitative and qualitative analyses about the frequency 
jnd character of the various interventions that the different 
principals tTiade. 
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Findings 



The findings have been reported In more sjrstematic detail and a 
series of papers that were presented at the annual meeting of the 
American Educational Research Association in March of 1.983 in 
Montreal (Rutherford, Hord & Huling, 1983; Hord, Huling & 
^ttegelbauer, 1983; Hall & Rutherford, 1983; Huling, Hall, Hord & 
Rutherford. 1983; Hord. Hall & Stiegelbauer, 1983). Some of the 
findings that related specifically to the change facilitator of the 
principal are summarized in Figure 2. In this particular analyses 
the Incident level inter vent iof^s were selected and comparisons were 
made In terms of the types and characteristics of the interventions 
that each style of principal did. ^ clearly can be seen, although 
many aspects of the principal interventions were similar, some 
striking and systematic differences were observed with the Initiator- 
style principals doing more of some types of interventions. Manager- 
style principals doing more or less of others and Responder-style 
prncipais doing more or less of still others. 

The overall conclusion from this systematic study of principals 
was that the principals did Indeed carry out interventions In ways 
thdt were consistent with each of the three change facilitator styles 
that had been identified. 



The reader is invited to contact the authors or the director of 
communications at the R&D Center for Teacher Education if they wish 
to know more about the conceptual framework, data analyses and 
findings from this study. In general It was observed that different 
principals were internally consistent in terms of the interventions 
that they made as would be predicted In terms of their overall style. 
Further, dS a result of the study it was possible to expand the 
'Inscriptions of each style and to develop a set of behavioral Indi- 
cators that could be used to more clearly Identify the kinds of 
interventions that would be characteristic of each change facilita- 
ting style (Hall, Rutherford, Hord & Hullngj 1983). 

Another set of analyses that were done that have turned out to 
be particularly interesting had to do with relating the principal's 
change facilitator style to implementation success. To do this, each 
of the 9 study principals were assigned a rating with regard to how 

ifjsely they approximated a particular style as described in the 
H'^ure 1 definitions. Based upon this rating it was possible to do a 
i orrpl dt lonal analysis between the change facilitating style of the 
princtpdl dnd implesTientation success (Huling, Hall, Hord & 
Hutnerford, 1983). 

Impiementdti on success was defined in terms of the concepts c* 
■..tcijes of Concern (Hall i Rutherford, 1976), Levels of Use (Hall & 
LCiC*";, 1977} and Innovation Conf igurdtions ^Hall & Loucks, 19B1) 
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Figure 2 

SUWARY OF IDENTIFIED CELLS IN THE PRINCIPAL INCIDENT INTERVENTION 
COOINOS THAT CONTRIBUTED HEAVILY TO SIGNIFICANCE OF THE X» STATISTIC 

Principals using the Initiator style did wore than expected: 

—Interventions for global rule and policy decision making (Function lA} 
—interventions taking place in classrooms (Location IC) 

Principals using the Initiator style did fewer than expected: 

••simple incident interventions (Sublevel 2) 

—interventions aimed at individual teachers (Target 2) 

••interventions aimed at central office innovation facilitators 
(Target 7) 

—interventions aimed at subsets of teachers as intact groups (e.g., 
all 3rd grade teachers) (Target 3C) 

—interventions that were interactive (Fl«m 2) 

Principals using the Manager style did more than expected: 

—Interventions to subsets of teachers as groups (Target 36) 

--monitoring and evaluating to report findings (Function 4C) 

—monitoring and evaluating that had to be specified by the coder 
{Function 4£) 

Principals using the Responder style did fewer than expected: 
--interventions that were coriplex incidents (Sublevel 3) 
?; --Intervention^ that were aimed directly at students (Target 1) 

Hal), G. E. & Ruthe'^ord, W. L. Three change facilitator styles: How 
principals affect improvement efforts. Paper presented at the annual 
meeting of the American Educational Research Association, Montreal, 

1983. 
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which are demonstrated ways for documenting tmplementation at the 
classroom level. To make judgments about which schools had more 
success a combination of research staff and key central office 
administrators from each of the study districts were brought 
together. They reviewed each dimension of implementation separately 
and rank -ordered the nine schools on It. These rankings were then 
combined to give an overall rating of Implementation success. 

The outcome of the correlational analysis was an overall 
correlation of .74 between change facilitating style and overall 
implementation success. This correlation was in the direction of 
schools with Manager-style principals having higher Implementation 
than schools with Responder -style principals and schools with 
Initiator -style principals had higher Implementation still. 

This analyses tends to support the work of Edmonds and the 
summary of lelthwotKl and Montgomery, as well as Venezky and 
Winfield's (1979) description of characteristics of principals In 
more effective schools. The Initiator style seems to get more 
dccompMshed in terms of implementation in a shorter period of time. 
It should be noted that the Manager-style principals were also seen 
as succ*?ssfu5, it was just that they did not move as far. Again, the 
Responder-style schools were not unsuccessful it is just that their 
rate of progress was slower, 

A related analysis that adds further light on the role and 
effects of the principal's change facilitating style was to examine 
tne psychological climate (Hall & Griffin, 1982) that was exhibited 
in each school. In terms of this analysis teachers in schools with 
Manager-style principals had a slightly more positive climate than 
r.eachers In schools that had Initiator -style principals. And climate 
'>':'jrys for teachers with Kesponder -sty le principals came out lowest. 

This analysis points out one of the dilemmas of the multi- 
/'jridte world that change facilitation and schooling is. On any 
iingle dimension one particular style of principal may look good. 
However, if the criterion for success Is shifted then another style 
.Ticjy seem to be more appropriate. The implication for all of us that 

involved In research, evaluation, training, policy development 
-i-id thtf monitoring of implementation Is that the criterion for 
s'^rcess that is being considered must be carefully thought out. 
Furtner, no one style Is likely to be perfect for all situations. 

A related discussion point out of the research that has been 
■j'jiH'j on dt the R&U Center for Teacher Fducation has to do with the 
;;), ',iD) 1 Uy, readiness and likelihood of a person changing his or her 
sn/lp. It IS our considered opinion at this point that a person does 
n')i cnanye change facil Hating style ,very easily. It is quite likely 
tndt i ndividual behaviors can be changed and that principals will 
ndnije tne Dehdvlor.s dS the context within which they are working 
'.nift'i. However, their overall style In terms of their motivation. 
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concerns and tone of delivery of interventions is likeijf to remain 
relatively constant. 

There are many Implications of this work, one cei tainly being 
that no two^day workshop is likely to change a principal's change 
facilitating style. It also suggests that in terms o" planning for 
implementjtion that the style of the principal should be considered 
more closely, since the ancillary support that a part cular school 
receives will likely need to be adjusted and be different in 
character depending upon the change facilitating style of the 
principal . 

This particularly comes true when a related set of findings out 
of the Principal -Teacher Interaction Study are reported. A 
!^erendipt tous discovery in this work was the identification of a 
Second Change Facilitator or Consigliere was a significant Intervenor 
in each of the nine study schools (Hord, Stiegelbauer & Hall, 1983). 
Regardless of the change facilitating style of the principal there 
was a second person who served a very Important change facilitating 
role. This Second CF or Consigliere was not necessarily the 
assistant principal and was not necessarily located within the 
building (although in the cases of Initiator and Manager-style 
principals they were). 

The reason for raising this particular finding here Is to point 
out th^t planning for change efforts in schools requires that more be 
Lunsidered than the style of the principal. Identification of the 
Consigliere becomes another key. We would further recommend that the 
principal and their Consigliere be provided with the leadership 
training in advance of Implementation, and that they be viewed as a 
.ridr^.jH f^c 1 1 1 tator throughout. 

It IS clear from the research that we have been doing that the 
principal IS important^ that different change facilitator styles can 
br ijfntititfd and described, and that the day-to-day behaviors of 
'^^incipals can De sorted in terms of those that appear to be more 
us*-ful 'ifkd helpful in implementation. It also is clear \hat the 
principdl Should not be considered in isolation from his or her 

i^'ri>juv':> -inu otner aspects of the school setting. The Consigliere 
1% d Miy fo\e and needs further consideration and elaboration. Also 
vHcj^acter 1 sties of the innovation itself need to be considered as 
irvlen^entation efforts are unfolding, 

'V:, J part of our ongoing researcn on supporting principals 
h^r, }n i.'TipIementation and examining the various role and 
t^'-it'Mjuxj and tecnni.^ues that can be used to facilitate implementa- 
i*an, tn^: ".et of Studies around the principal as a change facilitator 
^i/^ tyrnt^d uut to be very product ive» As research continues and as 
i<e no^ expiure the change process in the hi<jh school setting we are 
■ .^-r'lain fo Identify other key variables and factors that should be 
ifvj i^dvi be systematically considered in planning, facilitating and 
-\^)r)iior \nq school improveinent efforts* 
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We invite others to jOK in the search and we Melcome exchange 
of ideas and the sharing of findings with regard to other research 
and practice experiences that can be related. 
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IHbTKUCTIONAL MANAGEMENT ACADEMY 

Bruce Barnett and G1nn> Les 
Instructional Management Program 
Far West laboratory for Educational Research and Development 



For the past two years the Instructional ftenagement Program at Far Wiest Laboratory 
has been Investigating the role of the school principal. He have conducted Inten- 
sive case studies in 17 elementary and secondary schools* and have Interviewed over 
100 principals. Our purpose has been to Improve general knowledge about the 
principal's role In the hope that *« can provide alternative models of leadership 
for principals who work In different kinds of schools and who hold different 
expectations for their students. 

Our work demonstrates that successful principals: 

• Can and do affect instructional programs 

• Exercise their Influence through routine management activities 

• Take a wholistic view of t^wir role by linking their management actions to 
their views of schooling and the needs of students 

• Differ in the ways they approach Instructional management 

In addition, we have found that principals feel Isolated and value the opportunity 
to talk with other people interested in their role. For this reason, the Instruc- 
tional Managenent Program is continuing to conduct Instructional Management 
Acadefnies. The first of these involved several groups of principals from different 
school districts during the 1983-1984 school year. The aims of the Academy are to 
allow participants an opportut, ; to: 

• Analyse their managenent behavior through the processes of shadowing and 
reflective interviewing - . 

• f'ecpive support ami insight from working with colleagues 
« Learn what other principals are doing in their schools 



Propose^: Activities 

■jPvtTdl Acafipry wetinqs will be hel J during the year to allow principals to 

gather infcrnation from each other about activities they perform on a day-to-day 
basis. T^e sche^iule of neetings is as follows: 

Meeting 1 : Principals will be taught how to "shadow" another principal by 

recording narrative field notes. These records are not an evaluation 
of principals' actions, but a descriptive account of what they do. 
tac'' principal will be reauired to conduct a shadow with his/her 
partner before the second meeting. 



ERIC 



92 



fleeting 2 : Participants will learn how to use their shadow field notes to 
conduct a "reflective Intfervtew" with their partners. A reflec- 
tive Interview Is conducted after each shadow and helps to clarify 
the observed events and the meanings principals attach to these 
events. Participants will practice forming "preliminary" reflec- 
tive Intervl^ {Questions which provide useful background information 
about their partners' schools a«l their roles as instructional 
leaders. From this point on, at least one additional shadow and 
reflective Interview will be conducted before each subsequent 
meeting. 

. fleeting 3 : In order to determine how principal pairs are doing with their 
observations and interviews, the group will reconvene to discuss 
how the activities are proceeding. Suggestions for improveiront 
and/or refinement will be made. Additional techniques for forming 
"advanced" reflective interview questions will be taught and practiced. 

fleeting & : Using data frort previous shadows and reflective Interviews, parti- 
cipants will begin to identify specific "themes" that are emerging 
in their partnerr* schools. Once these themes are identified, prin- 
cipal pairs will determine .what information is needed to investigate 
these themes more fully. Subsequent shadows will be scheduled so 
that more specific data can be gathered. 

Meeting 5 : In conjunction with their partners, principals will use the informa- 
tion that has been collected during the previous shadows and reflective 
interviews to construct a preliminary model which provides a picture 
of their partners' schools and roles as principals. Participants 
win have the opportunity to react and respond to the models that 
their partners are composing. 

*<c^tipg_e : Based on their partners' reactions to their preliminary models, 
principals will formulate a final im>del. These completed models 
will follow our general framework, but will Include individual 
variations and unique connections between the school context, 
instructional management behaviors, school climate. Instructional 
organization, and stuctent outcomes. Models wl"!! be shared among 
qroup memf)ers in order to show similarities and differences among 
principals and school situations. 



T i ne f. onr i tmc n t 

The series of wetings, shadows, reflective interviews, and model generation 
sHoytr! t^Ve ahout ! 3 or 14 days of a principal's time over the course of the 
year. Meetings will last an entire day. Each shadow should take about four 
hours, and the reflective interview another hour. It is anticipated that each 
participant will conduct 5 or 6 shadows/reflective interviews during the year. 
Becau:;*^ of the tine connitnent and intensity of this project, it is recommended 
to princirais and school districts that this constitute the major professional 
ie ve"! 0,. pent activity during the school year. 
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Continued Efforts 

The needs and Interests of the Academy participants «m detenfiine what, if any. 
second year activities might be appropriate. For example, at the conclusion of 
tt» first year, t«o options for continued follow-up might be pursued. First, If 
some participants feel the shadowing process Is useful, we can begin to design a 
progr«n whereby Academy principals become trainers for other principals Interested 
In learning these techniques. Second, some participants might find this colleglal 
group of principals to be a useful support group for discussing topics of Interest 
or concern. As a topic arises, we can arrange for other principals (ones we have 
Identified as part of our ongoing work with principals) to attend Academy sessions 
to provide some insight and guidance. Between meetings, principals might be sha- 
dowed and interviewed, thus allowing them the opportunity to reflect on how they 
are dealing with this issue In their own schools. In all cases, any continuing 
efforts will be determined collaboratively with principals Interested in expanding 
the processes initiated during the first year. 

The followiny diagram was used to lead participants through a group exercise 
whJcn illustrates how all the components In the fitjure might Influence a 
desired student outcome. The figure itself was derived from our research. 
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Principals can understand and influence the varied elements of their organizations 
through the performance ot routine dftivities. Their success hinges on their ability 
to connect their actions to an overarching perspective of their school settings and 
their aspirations for students. 
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- ■ 'My father was a curias atx)ut how I msKte a living stlM^ying how, 
time and learning are related. He said, 'You rrmn youfifKlout that you 
spend more time arKt you team more'>' I said yes, and he t>urst out 
laughing anxS satd, 'Boy, you've r^ly ^ tfwm all canned: " 

' If you are evaluated with a test that is viewed as an indicator of the out- 
comes of education, but which Is not matched to your curriculum, you 
are in deep troul:^. Vba canrci possibly be effective as a ^hool or a 
teacher if you have taught one thing but have allowed your students to 
be tested on something else " 

"if we have to make clear to the students what it is we expect of them, 
then please notice that what is expected must be clear to the teacher 
— crystal clear A teacher who (toes not krK>w what is expected — 
what outcomes are desired — has been abandoned by the ad- 
ministrative staff of the district" 

'Good teaching is a logical issue. It need not produce learning. A teacher 
who starts a lecture on time, provides a review, gives an advance 
organizer emphasizes imponant points, asks higher order questions 
throughout, summarizes key issues, cracks a good joke, etc., maybe 
judged to be a good teacher whether or not the students learn." 
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' In deciding what I can share with you from my research back- 
grotind that might help you in your job of making schools more 
effective, I have decided r.o present a few rather simple propositions 
that are worth considering seriously as you visit classrooms. I 
understand most of you are principals and I think that you probably 
recognize that the whole movement toward effective schools rests on 
prlr^i pals' shoulders. Whether you like it or not, you have ended up 
on tlie spot and it means a new role for some principals, an instruc- 
tional leadership role. If you have not been visiting classrooms a 
lot» you are going to be pressured to do so. And when you get into 
the classrooms, you need certain kinds of spectacles to look at what 
goes on. I am going to try to provide you with some of those 
spectacles today— what to look for and what to think about as you 
visit classrooms. 

I boiled down a lot of what I wanted to say into a single 
variable or single statement. It seems to me that the single most 
Important variable in determining whether or not you have an effec- 
tive classroom is whether or not the delivered curriculum of that 
ciassroom is linked logically or empirically to the outcomes that" are 
desired. This is such a deceptively simple statement that it 
obviously needs elaboration. First of all it is concerned with what 
is sometimes called curriculum alignment, the congruence of the 
curriculum with the outcome, the overlap of curriculum with outcomes, 
or as It is most often called in the research community, opportunity 
to learn. 

A student must have the opportunity to learn what it is that is 
expected of him or her. For certain subjects, it's crucial. You do 
not ordindrily learn trigonometry at home. The family is an 
important educator, but families do not teach trigonometry. There 
are lots of school curriculum areas that families don't help v;i*;h. 
5ome social studies can be learned around the table at home, but 
Chemistry isn't usually learned at home. There are jarts of the 
scnool curriculum ^'^at will only be learned if we expose our children 
to It in schools. Otherwise, they will never get exposed to some 
things we deem valuable. 

Hhdt Is expected of the studenc must be made ciear to the 
student. The opportunity to lean It must be provided. If we have 
to make clear to the students what It is ^e expect cf them, then 
please notice that what is expected must be clear to the teacher-- 
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crystal clear. A teacher who does not know what Is expe :ted — what 
outcoffies are desired— has been abandoned by the administrative staff 
of the district. That is a harsh statement. But if I talk to a 
teacher who says, "I don't know what anybody wants around here", Vm 
pretty sur-' where the blame Is. I think It has to do with the 
administrative staff of a district not taking responsibility for 
saying, "this Is what's expected." In addition, I would add that a 
teache^r who knQW5 the csitiopfis th4t_ are desired, but-doesn't work 
toward them. Is probably unmonitored by the administrative team of a 
district. Monitoring whether classes are doing work related to 
outcomes that are valued Is a proper concern of administrators. If 
teachers do not know or do not work toward desired outcomes, what 
takes place Is more like babysitting than It is education. Some of 
the oldest issues In education revolve around this problem, kie need 
to know what knowledge or skills are worth acquiring. To repeat the 
title of a famous article at the turn of the century, we need to know 
"What knowledge is of most worth." The teachers and the administra- 
tors of a school district simply have to share a common belief that 
certain outcomes are expected for students at a given grade level in 
a gi^en school. 

I would remind you that the whole concept of effectiveness which 
brings you here today hinges on valuing some set of outcomes. You 
cannot talk about effectiveness unless you talk about what It Is you 
are trying to teach. The outcomes issue is primary in discussions of 
effectiveness. Good teaching is a logical issue. It need not pro- 
duce learning. A teacher who starts a lecture on time, provides a 
review, gives an advance organizer, emphasizes important points, asks 
higher order questions throughout, summarizes key Issues, cracks a 
good joke, etc., may be jidged to be a good teacher whether or not 
the students learn. Good and poor teaching Is determined by values 
«ind knowledge of what standards of practice are. A doctor may have 
patients that diet but If the doctor used the best practices, she may 
be judged to be a good physician. An effective physician however, is 
associated with many fewer deaths. The outcomes for medicine are 
manifestly clear, and effectiveness is, therefore, easy to judge. 
The Outcome for educators must also be made clear or we will not ever 
be able to judge effectiveness. 

Please note, also, that we neej not have 97 objectives for 
reading, 7^ for math, 85 for science and a few hundred others for 
pro-social behavior and physical education. The behavioral objec- 
tives movement, I hope, is past the day when it forced too molecular 
a view on people and trivialized teaching and learning. We should 
not, however, throw out the baby with the bath water. Ten to 15 
objectives for reading, another dozen or so for math, and another 
dozen or so for the rest of the curriculum are reasonable goals to 
^hoot fo^. For a single course in the junior high or senior high 
level a dozen or so objectives is all that is necessary to proceed to 
tninking about effectiveness. But effectiveness cannot even be dis- 
cussed without outcomes being prevalent in your mind. 
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{^tcofflcs <io not necessarUy have to be test scores. As educa- 
tors, we all have a legitimate Interes: In striving for (lozens of 
outcomes for which no acceptable tests exist. For example, we usual- 
ly state that we want to develop cooperative behavior among our 
students. This is an (wtcoiiie we rl^tly value and for which no 
acceptable tests exist. In this case, effectiveness Is still judged 
by determining If the curriculum delivered is logically matched to 
the outcomes^ desired..- -Xou- don't always need a test^ you. can collect 
evidence by observation. Effectiveness can be judged by observing 
classroom processes and analyzing if such processes are related to 
the Intentions of the district, A classroom that has downgraded 
competition and has implemented cooperative learning structures, uses 
criterion -referenced rather than norm -referenced tests, rewards 
helping behavior, etc., is one that is delivering a curriculum 
related to desired outcomes. If, however, tests are used as out- 
comes, then a concern for effectiveness means y mi should match the 
test to the curriculum. If you are evaluated with a test that is 
viewed as an indicator of the outcomes of education, but which is not 
matched to your curriculum, you are in deep trouble. You cannot 
possibly be effective as a school or a teacher if you have taught one 
thing but have allowed your students to be tested on something else. 

Are we educators so foolish that we have allowed ourselves to be 
trapped in so untenable a position? Is it possible that we actually 
use tests that are not matched to our curriculum, and in that way, 
vastly underestimate the productivity and effectiveness of our 
schools'? I'd like to share with you some of the data to make 
you think abcut the link that has to occur between curriculum and 
outcome to even start to talk about effectiveness. 

Tne study 1 cite has to do with the match between leading text- 
book series and some of the leading indicators, the tests, that are 
used around the nation to judge educational productivity and teacher 
effectiveness. At the fourth grade level, an analysis was done of 
every Item in the textbooks of the Houghton-Mifflin, Scott Foresman, 
and Addison -Wesley series and every item on the math test included in 
five different standardized tests used to evaluate instruction at 
that grade level. The interesting question is: what is the overlap? 
Well, in the worst case, where a school district might be using the 
Addison -Wesley series and using the SAT as an outcome measure, there 
was 47% overlap, meaning 53% of the Items on that test may never have 
been seen by the students before! (Figure 1) 

I come from Arizona. The school districts in my area have had 
these data since the day J gave it to them about three years ago. 
They are still using a curriculum series and a standardized test that 
do not match. We know education is slow to change, but *": is time to 
stop punishing ourselves this way. We have to ask questions about 
the instrumentation we use to judge effectiveness. If your curricu- 
lum and your tests don't matwh, you are in trouble. In the best case 
witn the Scott -Foresman series and with the MAT, 71% of what the 
students faced on the test were things they experienced in the text; 
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301 were not. We are vastly underestimating our effectiveness when 
we allow ourselves to get trapped this way. We should never have 
outcomes that don't match what we do in our classes. So, to deal with 
the effectiveness Issue you have to deal with outcomes and you have 
to deal with t>» curriculum, and ask whether they are sensibly 
aligned. 



Figure 1. The Percent of Items Cornnon to Both Texts and 

Tests in Regular Use in Elementary School Classes. 



Scoit-Foresman 
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Mjc first point Is simply that the effective teacher has to have 
a match between the curriculum and the outcomes. You can't talk 
about effectiveness otherwise. Students must have the opportunity to 
learn what Is on the test used to assess learning. But I said that 
It was the delivered curriculum that must be matched to outcomis. 
What do I mean by that? What does the term delivered mean? The way 
I use it, I define it as the in/olvement of students with materials, 
activities, ideas, concepts, and Issues in which they have a markev^ 
degree of success. That to me signifies that a system is delivering 
a curriculum. Students are engaged and they are succeeding at some- 
thing. That's the delivery system. A curriculum is delivered when 
students in a class show that they are engaged with and succeeding to 
learn what they are supposed to learn. 

Three concepts are important here, and I want to go over them: 
Allocated Time, Engaged Time and Success Rate. I've discussed these 
before, I've written about them. The work I did at the Far West 
LdOoratory a number of years ago revolved around them, but I continue 
to speak about them because you need to think about them as you go 
about your ii»ork in trying to improve schools. 
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Let me start with the concept of allocated time. There is a 
positive relationship between the time allocated In Instruction and 
achievement. Not every study snows It and when It's found It's not 
always a very strong predictor of achievement, but In general, the 
relationship between the time that's allocated to a curriculum area 
and the achievement In that area is positive and substantial. 

Whpn I first told my fath&r I was studying the relationship of 
time to achievement, started asking me questions, f^y father was a 
bit curious about how I made a living studying how time and learning 
are related. Hie said, "You mean you find out that you spend more 
time and you learn more?" I said "yes", and he burst out laughing 
and said, "Boy, you've really got them all conned. Does the govern- 
ment support that?" I said, once again. >-s". He said, "I'm sure 
glad I don't pay taxes anyraorel" But I ilr 1 finally turned him 
around when I explained to him that the nd j was not really that 
time and achiev^ent are In some way related. The finding that Is 
important, and one which every educator has to deal with, is that the 
variability in the allocations of time across classes Is enormous. 
Teachers make those time allocation decisions, and they are very 
important. Principals do not know what goes on behind the closed 
doors of classrooms. School superintendents don't know; state boards 
of education don't know. Teachers are making a set of complex 
decisions. Sometimes they are wonderful decisionj, sometimes they 
are not. 
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In Table 1 we present examples from our second and fifth grade 
reading and mathematics data. This Is the dally time allocated to 
mathematics by the teacher In these elementary classrooms. What Is 
of great Interest Is the variability. One teacher In the 5th grade 
allocates ^ minutes a day to mathematics, another allocates 73 
minutes a day. They're working with the same length of the school 
day and one Is providing 2*0 minutes, the other 73 minutes. It's easy 
to tell which class is likely to do better on the state test of 
achievement. I really don't know how much time should be spent on 
math. I also dont Know what's the maximum tipre students can spend 
at math before going bonkers. I am sure, however, that 20 minutes a 
day Is inappropriate. If you go into classrooms you ought to 
consider the time variable. 

With the grade five reading data the Issue is again not how much 
time, on the average. Is spent In reading (Table 1). The question 
is: What factors make one teacher allocate 6S minutes to reading and 
another one 137 minutes to reading? Two hours of time in a curric- 
ulum area is very different from one hour of time in a curriculum 
area. It's twice as much. What happens in a school to allow that? 

The allocations of time to the curriculum areas are determined 
by the elementary school teachers. At the junior highs and at the 
senior highs tncse times are fixed. The next question about alloca- 
tion, then, is: How much time Is allocated within the subject matter 
area to particular content areas? Both the junior and senior high 
teacner has to decide how much time to spend on two column addition, 
on quadratic equations, on ecology, or biology, etc. Again the issue 
is variation. For example, in the area of fractions, over 90 or so 
days one teacher spent zero time on fractions, toother teacher spent 
400 minutes teaching fractions to her c^ass. The state required 
fractions at this grade, but thi<; teacher did not spend any time on 
fractions. I asked the teacher at the end of the study, "You know, 
you didn't spend any time on fractions." The teacher said, "Really?" 
I sdid, "Yes." The teacher said, "I don't like fractions." 

My first response was anger but my second response was, I think, 
much more appropriate. The fact is that iione of us do what it is we 
don't want to do, and we confuse our personal decisions with our 
professional decisions. The teacher was making a personal decision--! 
don't like it so I'll leave it out. Teachers need to make profes- 
sional decisions. Very few teachers are reminded of this. A feed- 
back system is missing. If they drop an area of the curriculum out 
hf^rduse they don't like it, nobody is there to notice. There is not 
df>y feedback among teachers or by the instructional leaders to pre- 
vent this from happening. 

What has become clear from the r-jjcarch at Michigan State 
University is that the decisions made by teachers about what content 
to teach are based on three factors: how much they like the area; how 
much preparation the area requires for them; and how difficult they 
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perceive U to be for their students. Teachers hate to torture their 
students. So, If they think Us going to tie difficult for their 
kids chey might drop something out. "Hiose are personal decisions. I 
am not sure they are proper professional decisions. S.nce nobody is 
giving teachers feedback, we are always In danger of getting 
variability like this. 

TA£L£ 2 

HLOCATCD TlNf OlCISIOfiS I« OIFFERtllT CWITEfIT m^^ 
FOR RtADlNC {WADl S) ANO H«TH£MATICS (GRACE 2l 



RIADIML 1 LAM&yACr ARTS 

Tot4l Allocated Minutes 


rtATHEMATICS 

Total Allocited Minutes 




1 


Class 
3 


Cless 

u 


ClASS 

2S 


Content Area 


Class 

3 


Class 
21 


Class 

S 


Class 
13 


Synthesis I 


23S 


25? 


143? 


306 


Coffiputatfon; 
Speed Tests 


£32 


31 


71 


100 


Ce^f^^^€ fusion 
Ac tivi ttes 


122 


151 


1649 


383 


Kord Problems 


109 




416 


132 


Oral J'l'dlmq 


604 


63 




30b 


Fracttons 


Q 


21 


63 


399 




St 


343 


96 


573 


Linear 
Measurement 


29 


130 


107 


400 



•datttJ frcir :,1s^fll» 1977 la) I 1977 it), A stor» con^lete discussion of these (Jata 

may ♦ounrt in Se'"11"ei'. 1979. 

The same is true of the reading area. The jllocation of time 
there becomes important because of what is now a national concern, the 
area of comprehension. Allocated time in comprehension in these 
classrooms is presented in Table 2. In one classroom the average 
child spends 122 minutes doing translating and paraphrasing, 235 
minutes in inference and synthesis activities. These children are 
trying to read something and answer the question, what does it mean? 
Tney have to put it in their own words. Now, those of you who have 
been arou 1 in the last decade know that students couldn't decode 
jnytmng bacn in the 1960s and up to the 1970s. In this decade, they 
decode fine; they just can't understand anything! That seems to be a 
national concern. Well, if that's true, one of the reasons that one 
might be concerned about time is whether, in fact, students are 
getting any instruction in comprehending. One of these clai "rooms 
manages to total about 400 minutes in comprehension activities in its 
reading and language arts program. As is seen on Table 2, another 
classroom gets 3,000 minute: of such instruction. It's not 
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very difficult to figure out «*^lch classroom Is likely to do better 
on that one Item on the State test that says: "Read this paragraph 
and tell me which of the following statements is the best title for 
the paragraph." It's a comprehension item, and it's on every test 
from about third grade throu^ college entrance. allocdti(H) of 
time, the decisions about what content to teach and bow much time to 
put in are very crucial decisions and they are. often made without 
much discussion with and feedback to teachers. 



Engaged Time 

The next concept that has to be dealt with in talking about 
Instruct iofMl delivery is tte issue of engaged time. The issue of 
engaged time is not very startling either. Hy father would be 
incredulous, once again, when he said, **You mean if kids pay atten- 
tion tftey learn morer As I said, "Yes," he'd laugh again and 
wonder how you make a living telling people such startling news! The 
issue has nothing to do with that common sense finding. The Issue 
is, do classrooms vary enormously In the mean engaged time recorded 
for the class? The answer, again, is yes. In one classroom you find 
f>OX of the students engaged at any one time you are looking. In 
another classroom 90% of the students are engaged at all times. 
What's the difference between the two classrooms? What does it mean 
for the delivered curriculum? Very simply. If a teacher has a 50 
minute allocation to math, and 50% engagement, the children are 
getting 25 minutes a day. If there is 90% engagement, the students 
get 43 minutes a day. That's 20 minutes a day difference in time. 
That equals 100 minutes a week. Those are big blocks of instruc- 
tional time. What is delivered in sheer amount of curriculum to 
students In two different classrooms may be very, very different. 

It is Interesting to think about the delivery of curriculum and 
the time variables as follows. We can start by thinking of a school 
year, and then must say but it's not a "year", it's only 9 months or 
l^^U days. But then, it's not really 180 days, because we have to 
subtract from that. What do we have to subtract? Well, the teacher 
Is absent once In a while, the kids are absent once In a while, the 
teacher takes a mental health day once in a while, the buses break 
down, snow occurs and you don't make up the day, etc. What are we 
back to in terms of instructional days in a district? 150 at most? 
Let's say 150 Instructional days. I don't thinu that's uncommon. 
And let's >s:;y many of the early grades are allocating 30 minutes a 
cHy to mathematics at a 50% engagement rate. You then are delivering 
15 minutes a day of mathematics. Lets go over that again. If 30 
minutes a day is what is allocated for 150 days, that gives you 75 
hours of mathematics instruction for the entire school "year." And 
if the engagement rate is 50 percent, then what's delivered In 
mathematics is 37-1/2 hours of time on task. By adult standards, 
that's under one week's work. It is not any wonder to me, when I 
think about standardized testing programs, that getting two Items 
rjght can give you 8 months advantage on those tests. If all we're 
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delivering In certain classrooms Is 40 hours of delivered curriculum 
In math, about two Items more Is ali >ou can expect for the whole 
j^ear. 

NoM, these kinds of daia are not meant to say that all teachers 
are like this and that every classroom suffers. But If you're 
taUiny about school effectiveness, you fnight want to find those 
classes where these kinds of data are obtained. Maybe It's 20% of 
the classes In your district*, isaybe It's 15%. But whatever the 
number, those classes can be helped because these are remediable 
kinds of variables. If you want a more effective school, you've got 
to get more Instruction delivered. It's not a very difficult concept 
to deal with. Ue worked In schools where we were able to peek In 
classrooms that we weren't Invited to look In. All of our teachers 
were volunteers, but because many of them were In pod schools, you 
could sit In the center of the pod and watch the teacher who Invited 
you, and all the other teachers, without them knowing. An Interest- 
ing question Is: Uhat's delivered In some of those classrooms that 
we weren't Invited Into? We had the fueling that some large percent, 
somewhere between 5 and 15 percent of the school classrooms were not 
delivering lOU hours, total. In reading and math, in the elementary 
grade levels! Do you want to have a more effective school system? 
Find those classrooms and provide feedback for those teachers. Most 
of them didn't know what they were actually del 1 verlng. They aren't 
used to thinking that way. These concepts help you to think about 
classrooms and, thank goodness, the numerical values of variables 
iue hOM much instruction is being delivered are easy to change. 

The engaged time variable, we think. Is very Important. After 
we finished this project, 1 went to the library to do some further 
research on what we had done. I found out that we had replicated the 
results of somebody who did this study in 1888. In fact, the Issue 
of time and instruction is on a 20 year cycle, A man named Curry in 
li884, and then Judd again In 1918, and then some people In the 
193US, and Phil Jackson in the 1960s, and then some of us in the 
7Us and 8Us are part of the cyclical discovery of time variables. 
Everyone says time Is Important, and every 20 years someone says not 
enough of it is being spent. People are concerned about time. It's 
not a magic variable; It's not a very complex variable. But the 
allocations of time to instructional areas and then the engaged time 
in those instructional areas are very important concepts with which 
to think about classrooms. 



Success Rate 

The next concept 1 want to deal with is that of success rate. 
Again, in our study, we found something we think gets rediscovered 
every now and then. That is the concept of success for young 
children. Me studied whether the children were succeeding Jt what 
they were doing or whether the material was too difficult for them. 
Our thinking was that the match of curriculum to a child is an 
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important and very ccunplex teacher behavior. And of course teachers 
are not sadists. If they see children falling at something, they 
< change the curriculum as quickly as possible. Nevertheless* In our 
study Me did find classrooms where 14% of the school day would be 
coded by our observers as high failure experiences. Students were 
constantly falling. Would you like to have a predictor of falling 
performance on outcome measures? Falling performance In a classroom 
1 s a very goud one! 

If a child can't do two column addition in a classroon!. a child 
is not going to do two column addition on an outcome measure. If a 
child succeeds at two column addition in the classroom. It's very 
likely the child will do well on a two column addition problem on the 
outcome. So, looking at the success and failure rates within a 
classroom becomes an important concern. In our study, we found that 
high success was Incredibly Important for young children, ttere 
Brophy and Barak Rosenshlne, researchers In this area, say that 
unless recitation activltes are at the 80% success rate they're 
likely not to produce much achievement, and unless seatwork or home- 
work is up around 95% success, they may not have much value. And 
that seems particularly true in those areas of the curriculum that 
are hierarchically formed, like mathematics. If you don't really 
learn addition, you're going to have trouble with multiplication, and 
if you don't really learn subtraction, you're going to have trouble 
with long division. There are lots of areas of the curriculum that 
are hierarchically formed, and it means that success early in the 
curriculum does determine success later in the curriculum. Our data 
are clear on this for young children. Thus success rate becomes an 
important variable for thinking about classroom instruction. 



Acddefliic Learning Time 

I've talked about allocations of time and I've talked about 
engaged time and I've talked about success rate and I want to bring 
those together for you, in the single concept that I think is one of 
the important ones to think about when you go into classrooms. It's 
the concept we called academic learning time, ALT, One of the pro- 
ducts of the many recent studies of teaching that I think is 
important is this ALT variable. We've defined it in our work as 
engaged time with materials or activities that produce a high success 
rate and that are related to the outcome measures that are being 
used. It characterizes a lot about what I've said about the align- 
ment of curriculum with outcomes and about the time variables. Let 
(I** try to define it better with a diagram (Figure 2). We said tht 
trie allocation of time at the junior and senior high schools is 
fixed, but at the elementary schools the teachers make the decision 
of how much time to give to music, reading, math, etc. We started 
with the notion that there is an allocation of time. The next con- 
cept we analyzed was engaged time which is some subset of the 
allocated time. You don't expect these variable to be equal. That 



98 



los 



Figure 2. Defining Academic Learnmg Time (ALT). 




LSR ~ Low Success Rjte ALT ^ Academic Learning Time 

MSR - Mrdium Su4:ce^» Rat€ 
HSR = High Success Rale 

InhTprcfahun: The time aUocated for in^tructnm i> shoun visually in (a). 
Dunng »>omf uf thi^ tioie, § tudt^nt*; are fe'ngat;cd, as ishau n in (b) Scuiu* of 
the timf studenr** art* en^^j^t'd i?> limc related to the outcome measures 
that are u&ed to asae^^s^ instrui:tu>n. This is sho A n vi^ualJv in (c). The time 
allocated, u hcther en);*i^ed or nut, and u hither related to the uutci>me 
mcasufft^ ur not. can by \ leldm^ lou , medium, uf hi};h success rates iv 
studetiS fd) That purti.in uf alU^'ated time thjr is time en^j^ed in 
aKtmth'^ rt'lafed to the uu^.^"^e fnea^urc> ijnd u huh provider students 
Vk !t; I *f hi<;;h success rjte i? defined as Academic LeJrnjnj; Time, as sho\% n 
in (e) 



U. you don't expect 1UU% engage'! time. It's a subset. 90% would be 
nice, 85X would be nice. 2Q% would be bad. 

We also said that you could conceive of the success rates of 
students when you're working with tneis: some of the time they 
are engaged they will be having high success; some of the time they 
are engaged $hey win be having medium success; and some of the time 
they will experience very low success. And you sort of hope that the 
amount of time the^r spend In low success activities would be small 
because failure Is not good on a regular basis, ^toreover. In our 
work, we found out that high success was an extremely Important 
predictor of achievement. 

So these are the concepts we have worked on so far, allocated 
time, engaged time, and success rate. I started off by saying 
one of the key variables was whether the curriculum Is related to the 
outcome. Well we dont expect everything a teacher (toes to be 
related to matcomes. If we did we'd have automatons as teachers. 
There 'd be no spontaneity; there'd be no fun In teaching. The 
biggest criticism of Becker and Englemann's programs, the Distar 
programs, is not that they dont work, because they do. The biggest 
criticism Is that they force teachers Into reading from manuals, 
pointing when they're supposed to, having students chant when they're 
supposed to. etc. Every part of the teacher's activity Is, in fact, 
related to the outcomes as defined by Becker and Englemann, and It 
drives a lot of teachers to drink at an early age. Hot everything 
that's going to happen in classrooms is expected to be related to the 
outcomes. If a teacher Is teaching a geometry lesson and somebody 
says, "that's a beautiful shape," It's perfectly sensible that the 
teacher Mould talk about how the concepts of beauty and the concepts 
of geometry were once wedded and that the history of Western civili- 
zation is based on philosophy and mathematics being Intertwined. 
Nevertheless, some part of the teaching act ought to be related to 
the outcomes. I've never seen a geometry test that asked about 
beauty. I have seen many geometry tests that check If students know 
the number of angles that are equal in an Isosceles triangle. And 
the teacher is there to teach some things like that. 

Now, let's put this all together as we have in Figure 2. We say 
that some part of the allocation of time, whether It's fixed or 
variable, depending on grade level, is engaged time. Some part of 
that time is also related to the outcomes, and some part of that time 
is high success. We're calling that Intersecting zone academic 
learning time. You can measure it In minutes. You can walk into a 
classroom and get a feel for whether the class Is Involved in the 
things they're supposed to be. We can measure It; we call It ALT. 
It's not easy to measure, but it's a very good predictor of achieve- 
ment. Why shouldn't It be? It says that kids are engaged. It says 
that they're succeeding at tasks like the ones that are part of the 
Outcome, and that what they're doing is in fact related to the out- 
comes. It re<illy is a very interesting variable. 
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NoM, 1 nave to ask you to think for a moaent atKHit the variable 
of ALT again. When we created It we didnt quite have the full 
picture In mind. We were accused by many educational researchers and 
psychologists of measuring the measurable. You know, we go out with 
stop watches and we count things, and we go fo the easily countable, 
the easily measurable, and we never (teal with 'quality.** I hear that 
aU the time. The ALT variable may be revolutionary, in a way, 
because It may be the first measure we have of quality. Td like to 
challenge you to give m^ a better definition of quality Instruction 
than mine. You walk into a classroom and the kids were working on 
activities or with materials or dealing with things that are related 
to outcomes that are valued. They are engaged and they are suc- 
ceeding at what they are doing. What else do you want? It strikes 
me that If I walked Into a classroom and I could say that, I would be 
very happy. I can't hold the teacher responsible for the achieve- 
ment that's going to show up on the test, but I want to be able to 
hold ray teachers responsible for the classroom behavior I observed. 
Students should be doing things that are related to outcomes, they 
should be succeeding at them, and they should be engaged in the 
tasks. It strikes me that that's a pretty good working definition of 
quality in instruction when you are l(K>king behind classroom doors. 
And I think, therefore, that the variable Is not just easily 
measurable and just dealing with t^me. I think it becomes a very 
Important concept for looking into classrooms. 

One of the criticisms teachers have always had of the f^ople who 
look Into their classrooms is that they didn't know what to look for. 
That's why teachers were rated on such things as the neatness of 
their bulletin board and their clothing. I think with the advent of 
ALT, Me are at the point where we can say, we now know what to look 
for. We do know what events are likely to produce achievement in 
classrooms. Is there evidence for this? Well, yes. It's not of the 
type that might overwhelm the Nobel committee, but it's of the type 
that might be very useful to an educator. 

Let me interpret some of the data in Table 3L Envision three 
children who start out with a raw score on a test of 36, They're at 
the SOth percentile on our sample. These are three avt^rage kids in 
the sample we useJ. They then proceed to work for the next five 
weeks in their reading and we count the number of minutes each day 
that we would call ALT, /teademic Learni»ig Time. ALT is the number of 
minutes in which they are engaged in, succeeding, and working on 
tasks related to the reading outcomes. In one class, the children 
accumulated 100 minutes of ALT, In another class 573, and in another 
1300. The average daily time, in minutes, turns out to be 4 minutes 
a day. 23 minutes a day, and 52 minutes a day, respectively. The use 
of the regression equations ne created for estimation gives us the 
following information. Fi-e weeks later we can expect the child who 
got four minutes a day of ALT to pick up one more item on our test 
and get a score of 37, The second child gets seven more items on the 
test right, and gets a score of 43, The third child gets 16 items 
more and gets a score of 52, They've all been working at reading. 



101 



ERIC 



111 



but their growth is different. More important, their placement in 
th^t sample is vastly different. Here are three children who start 
out aterage and end up, based on ALT, at the 39th percentile, the 
50tP percentile, and the 66th percentile on the same kinds of tests. 
It's a pretty powerful variable. At least powerful enough to take 
seriously. 



TA8LE 3 

ACADEMIC LEARNING TIME AND STUDENT ACHIEVEMENT; 
EXAWIES FROM GRADE Z HEAL ING BASED ON 
BTES (PHASE in-B) RESULTS 
iA-B PERIOD) 



Readtny Score 


Stuftent Engaged lime 
In Reading 
with Hiqh Success Rate 


Cst1»ate4 Reading Score 
at B tDecem£>er} 


Scurf 

(out 0^ 100) 


Percefttl le 


Total Time 
Over S Weeks 
(Hlnut:$) 


Average 

Dally Time 
(^•inutes) 


Rate 

Score 

(out of 100) 


Percentile 


it 


SO 


100 


4 


37 


39 


H 


SO 


573' 




43 


50 


lb 


5U 


1300 


S2 


5? 


66 




17 


100 


4 


20 


IS 


if. 




S7j 


23 


25 


21 




I? 


i JUU 


5^ 


35 


36 



i »r rt.cfj.jH f,f school day^ occurred between the * and B testing. 

ff,,. f( rt-*^ing vcorps sre pitimated *ja linear regression. 
, 'r« .aiiifj of all vanatlcs in thts table are within the ranges actually obtained in the BTES sample. 
4 '^f i.pra;* enqaqefl time with high soccess rate in grade ^ reading for the A-B period was S73 minutes. 



In the data I presented to you, it ina> appear that the range of 
4 to 52 minutes a day i5 unreal 1 stically large. These values, 
however, actually occurred in the classes in our study. Furthermore, 
one cdn easily imagine how either 4 or 52 minutes per day of academic 
iMdrmry time might come about. If 50 minutes of reading instruction 
per day IS allocated to a student who pays attention only about a 
tnird of the time and only one fourth of the student's reading time 
IS at a high level of success, then that student will experience only 
about four minutes a day of engaged reading at a high success level. 
Simildrly if lOU minutes per dfty is allocated for reading for a 
stjd*»nt .-ho pays attention B5% of the time at a high level of success 
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for almost two thirds of ttie time, then that student wiU accumulate 
over SO minutes a d^y of ALT. These differences In AIT do result In 
differences in achievement. 

So, I believe ALT Is a good predictor* Thus, If ifou need to go 
into classrooms and are worried about whether a teacher will be 
effective or not, why don't you ask some questions like the 
following: Ask If the time allocated Is adequate for the currlculuia 
area or to the content areas within that curriculum area. Ask If the 
engaged time Is sufficient to ensure that what Is delivered might 
actually result In learning. Ask If students appear to be successful 
in their classroiM) work. Ask if the work is logically related to the 
outcomes of the course or. the curriculum area. Mfc If tto pace Is 
sufficient to cover all the objectives held for the course or for 
that grade level because If the pace Is not sufficient, students would 
not have had the opportunity to learn all they are supposed to learn. 
In Tucson, I went to a group of teachers In the same grade level who 
were working with the same Basal series and I said, "Uhere are you In 
the teacher's manual that goes with this series?" They said "What do 
you mean?" And, I said, "What pa^ are you on? How much of It did 
you cover?" Mell, some were done and had been done for a month, and 
were on to all sorts of reading enrichment programs. Some were on 
page g9 of a 40C page teacher's manual. That's pace. The raw amount 
covered would seem to be a goc^ predictor of achievement. Why not? 
If people aren't exposed to certain things, they're not likely to do 
well on tests of those things. In the cross national comparisons 
Detween the United States and other countries, the single most 
important variable explaining differences in the achievement of dif- 
ferent countries was whether or not students in those countries had 
been exposed to the content. 

Then, after you ask that set of questions, you have to arm 
yourself with some observational instruments that reflect a set o* 
teaching variables that you believe In to see how those variables 
might affect the delivery of the curriculum. What teaching variables 
shoutd you look for? What are the ones to have faith in? I think 
everyone has to find th« out for themselves and read the literature 
for themselves. I'll tell you what my favorites are from my research 
and my reading of the literature, I think most of this list would be 
agreed to by other people, but certainly not all of it. Structuring 
feedback, monitoring, conviviality, handling transitions, management 
of deviance, safety, order and academic focus are some of the things 
I look for when I go into a classroom, 

I look at structuring because it tells children what to expect. 
Bv structuring we mean the teacher tells the kids what they should be 
doing. Instead of the teacher saying, "O.K. spelling", the teacher 
says, "We're doing spelling. We're on page 47 of the workbook. 
Everybody get out your spelling books and those of you that are 
excused from it, here's what you're to do." They structure the 
actuity. Why is this important? A couple of reasons. Kids often 
don't know what the command "spelling" means. In a highly mobile 
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society like \>urs, we're dealing with 50, 60 and 100 percent turnover 
In souse of the urban areas. The teacher may present the rules for 
classrooms early In the year, but by mid-year ipost of those kids are 
90f^ and the teacher then Is assuming that the Shorthand way of 
teUIn^ k1(ts what's to be (tone Is uftderstood* Some of those kids 
haven't 99t a clue! The teachers who structure tell students what's 
expected, where to be In the material, and give directions. Teachers 
who structure seem to be those that in fact have higher achievement. 
Of course It can be abused. We saw one study done at Wisconsin where 
the Instructions for what to do far exceeded the doing of one 
workbook page. The teacher went on 20 minutes about how to do It and 
the kids were through In three. There are extremes of structuring, 

I look at feedback because our research says that academic 
feedback keeps success high. It keeps children from being failures 
too long. The teacher says, "That's not correct, here's how to do 
it." A teacher who finds ways to provide academic feedback often has 
children whose success rate Is higher, and that's a predictor of 
achiev«nent. 

I look at monitoring because In today's schools, particularly 
the elementary schools, students have as much as 60x of the school 
day spent at independent work. Kids work at tables. They work In 
workbooks. They work on those blue sheets that elves produce at 
night in schools. Every morning there are stacks of elf -supplied 
worksheets. And If nobody is monitoring what children do, then it's 
not nuSjual to find a second grader not doing It. What does that 
mean for the teacher? It means you have to wander the class or have 
an aide who wanders the class and keeps the monitoring rates high. 

I look at conviviality, which is our code name for a whole bunch 
of things. Conviviality shows me that the classroom is a nice place 
to have kids. It means the attendance is likely to be high, the 
sickness rate low, the throw -up rate low, the anxiety down. And 
that's what you want for kids. They can't work unless they feel 
comfortable and safe. 

I look at whether a teacher handles transitions adequately. In 
our study of management of time in classrooms we had one teacher who 
Mas very concerned with having a modern classroom with resource 
centers all around the classroom—a listening center for reading, a 
math facts center, a social science center, the hamster center for 
studying this and that. Every 20 or 30 minutes children would be 
moving around the classroom and the teacher had what was clearly an 
exciting place to be. In a 306 minute school day, 76 minutes were 
clocked as transitional time. The kids were getting into activities 
and g^'tting out of activities and not spending the time in the 
activity. One should look at that. The greatest transitTon problems 
4rg Kith art teachers and physical ed teachers. It takes so long to 
get ready to do art and physical ed and it takes so long to break it 
down and put it away that sometimes we actually lose art and physical 
ed. But the same is true of reading In some classes, and the same Is 
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true of mathematics. The transitions need to be handled. When I go 
out into classrooms I look at the transitions and their effect on 
engaged time, because if the transitions are too long, engaged time 
plufnmets. 

I look at management of deviance and I look for the kind of 
teacher who has what Kovnin called with-it-ness. I look for teachers 
who can control the classroom. Mho make very few timing and targeting 
errors in the way that Kovnin talks about it, Walter Borg talks about 
It, the way Emmer and Evertson talk about these concepts now In their 
handbooks. I look at whether the classroom and the school are safe, 
orderly, and academically focused because we now know you can't 
expect achievement in a place that's not orderly or that's not safe. 
An academic focus is important, but that doesn't mean the teacher 
can't iaugn and joke and have a good time, and that kids can't be 
hdppy. It means that after the laughter and the joking, the teacher 
knows to bring them back to the task at hand. 



i>unmary 

Teacher decisions and behavior affect what parts of the curricu- 
lum the student learns. They pick the tasks and the tinte on tasks. 
Teacher's decisions and behavior affect the success of students in 
class. Teacher's decisions and behavior affect the students' engage- 
ment and the time on the right task in classes. Teacher decisions 
and behavior affect the students' attitudes toward schools which 
affect attendance, climate, and management. In my view the teacher 
decisions and behavior only affect achievement outcomes if they work 
through student Involvement and success with the right tasks. What 
are the right tasks? At least some of them are the tasks that are 
used to judge effectiveness. Thus, my original, deceptively simple 
point IS slated again: Teachers who deliver a curriculum to students 
that is matchfidl to outcomes are likely to be effective. What is nice 
is that research has helped us find a good classroom indicator of 
whether effectiveness is likely, that is the ALT variable, con- 
sisting of allocated time, engaged time, success rate, and the 
reldtlonship of activity to outcome. I hope these ideas are helpful 
ds you go out ana observe classrooms. 



Research and Teacher Effectiveness 

Thpse are good times, really. Kesearch on teaching has given us 
d set of variables to look at that relate to engagement and success. 
These should be looked at closely. Research has given us an 
advantage over preceeding generations, and I think you should use 
that research wisely. The "Nay Sayers" say that our findings are 
weak, that the correlations are low, that the experimental findings 
don't always hold up. That may be true but that doesn't mean that 
research can't produce any useful ideas. The original study of the 
effect of cigarette smoning on cancerous conditions showed a correla- 
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tlon between smoKIng and cancerous cells In the lungs of about .14. 
It's trivial. In education we say "1 won't pay any attention to 
correlations like that." Nevertheless, It makes sense that cigarette 
smoking Is likely to produce some harm. Some of our variables In 
education make sense, even If the correlations are not high. 

1 think we're short changing research. Two and three percent 
increments In our knowledge about what happens to kids are powerful 
findings. The research that we have now does that. Its strength 
is also that It Is quite useful. For example, the ALT concept 
may be a way to measure something we think of as "quality." So I 
think a revolution Is taking place. Research Is on Its way to help 
us in understanding the elusive nature of quality. We will In time 
be able to provide Insights Into Instruction that Is both "good" and 
that is ""effective." 1 can't give It all to you In a brief visit 
like this, but if you'll read widely In this literature and Interpret 
the literature humanly, you'll probably end up thinking of your 
teachers as handling one of the most complex environments we've ever 
asked anybody to face. 

HoM do you take care of pace and make sure that everybody gets 
through, while at the same time you're keeping success rate high? 
How do you keep engagement high when you've been given malnst reamed 
kids and you have to pay special attention to one or two kids in your 
classroom? We've asked the impossible of teachers. The research 
findings are going to have to be filtered through you, as instruc- 
tional leaders, and be used humanly in studying the context that 
you're walking into. The issue of pace may have to abandoned for 
part of the school term as the teacher is just simply establishing 
order. The Issue of success rate may have to go by the boards as the 
teachers bring something else Into line. Many teachers say, "I wish 
you'd come visit in Itovember, I don't get my class started until 
then." They've had them since September, but they may be right. It 
takes time to get these systems going, and we can't just apply 
research evidence and say why aren't you teaching fractions? It may 
be inappropriate at that time. You have to check with your teachers 
and use them as guides, too. I've learned to do that as I've talked 
to them. If you think about the hufaane use of the research, I think 
you will find that the research can help you improve your schools. 
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"If teachers establish reasonable and workable rules, hold positive 
expectatioris for student participate^ in those rules, arxi insist upon 
appropriate behavior when necessary, I believe that stud&Jts wiN 
understand the teacher's seriousness and purposefulness about 
classroom management and will begin to internalize classroom mtes, 
expectations, and procedures." 



"In the last decade researchers have produced direct evidence to 
refute the myth that teachers do not make a difference. This is impor- 
tant informatbn in relation to pdicy, because it indtoates that teachers 
are a vital investment." 
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TEACHER EFFECTS 



Thomas L* (sood 
University of Missouri -Columbia 



This paper presents some recently reported findings that 
•associate teaching behavior with student achievement. It is 
important to emphasize that research on teaching effects cannot be 
equated with teacher effectiveness per se. in part because research 
nas primarily emphasized ti^ effects of instructional behavior on the 
mean or average performance of students w achievement tests. 
Although this is certainly important Information, teachers are 
expected to accomplish more than simply stimulating student achieve- 
ment in basic areas. Those who wish to use the results of this 
research In teacher education and/or evaluation programs should 
therefore study the limitations of extant data. These limitations 
have been discussed at length elsewhere (Brophy & Good, in press; 
Good, 1983, in press; Good & Brophy, in press). Furthermore, I 
believe that presenting research information about improving class- 
room performance to teachers will be effective only If the findings 
are accompanied by detailed information about decision making 
(applying findings to particular contexts) as well as knowledge about 
student learning and development and subject matter and curriculum 
development. (For a detailed discussion of this perspective see Good 
& Brophy. 1978. 1984). 



General Review 

A major purpose of this article is to describe some of the 
variation in classroom process and to illustrate how these behaviors 
influence student achievement (for more complete reviews see Brophy, 
1979, 1983; Good, in press; Good. Grouws, & Ebmeier, 1983; Good & 
riinkel. 1982; Rosenshine. 1983; Weinstein, 1983). 



The author gratefully acknowledges the time and resources made 
available at the Center for Research in Social Behavior, University 
of Missouri -Columbia. He is also grateful to Patricia Shanks for 
typing the article and to Gail Hinkel for her careful editing of the 

** The author has written extensively upon this topic recently, and 
portion, of the present article have drawn upon other recent articles 
Brophy & Good, in press; Good, 1982, 1983, in press; ^od & Brophy, 
in press; Good & Hinkel, 1982). 
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Variation In Tlioe Usage 



Data collected In the Beginning Teacher Evaluation Study has 
shOMn that the amount of time allocated to a particular topic varies 
considerably from school to school and from classroom to classroom. 
Furthermore, once Instruction In a subject has begun, studies sho« 
that the actual time spent on Instruction varies among classrooms* 
Estimates differ, but studies basically Indicate that only about 50 
to 60% of the school day Is actually used for Instruction. 

However, although variations In amount of time -on -task occur 
across days, students, and classrooms, little research has attempted 
to ascertain the sources of this variation: student factors, class- 
room teaching practices, or day-to-day fluctuations. It Is clear 
from a variety of studies, though, that teachers' beliefs and 
" behaviors are strongly related to time utilization (e.g., Arlin, 
1982; Schmidt & Buchmann, In press). 

Finally, It is worth noting that some areas of the curriculum 
appear to receive but little instructional time. In a study of 75 
teachers in Grades 2-6, Ebmeier and Ziomek {1983} found that an 
average of only 15 minutes per week was spent on science in second 
grdde classes. By fifth grade, this time had only increased to 43 
minutes. Furthermore, the time spent on science in most classes was 
considerably lower than what the district recommended. 

Mode of instruction is a manipulable variable which has been 
shown to be related to engagement. Using the BTES data, Rosenshlne 
(1980) found that engagement was 70% during unsupervised seatwork and 
84% during teacher -led discussion. These differences are important 
because students spend about 70% of classroom time doing seatwork, a 
practice necessitated by grouping. However, whether whole- or small - 
group instruction Is better depends upon whether the losses in time 
through grouping are compensated for by Increased quality of group 
instructiion (appropriate seatwork tasks; instruction which Is better 
matched to students' ability). However, most empirical evidence 
suggests ittat too often classroom designs that call for large amounts 
of student seatwork are marked by insufficient procedural details and 
tasks that are poorly matched with student ability (e.g., Anderson, 
1981; Doyle. l^B2). 



Studies of Time and learning 

Most recent studies of time and learning involve engaged time, 
reflecting the opinion of many persons that an Indisputable relation- 
ship has be^n established between engaged time and amount of learning 
(3org, 1980; Harnischfeger & Wiley, 1976; Sirotnik, 1983). Itowever, 
others are more qualified in their support of this relationship 
(Husen. 1967; Karweit, 1976; Kepler, 1980). 
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Pro&leffls wUh Time Research 



Part of the ppoblem with studies of time resides In the fact 
that time measures In many studies have been taken Independent of 
measures of Instructional behavior (what and how «e11 are teachers 
doing), classroofn organization, and curriculum task. The early empha- 
sis upon tlifie measures per se (Independent of context) were under- 
standable but given extant knowledge and our Increased capacity for 
studying time (1.e., methodological advances In the BTES study}. It 
is time to become more Integrative and comprehensive In our research, 
C\e6r]}f, the work by Berliner (1979) shows that more refined measures 
of time (e.g„ academic learning time) are more strongly associated 
with student achievement than are measures that do not consider the 
quality of time (e.g., allocated or engaged tl^ie). 

Among the msny reasons that time measures do not predict 
ac? ievement better Is the fact that the curriculum tasks students are 
assigned can be Inappropriate or Irrelevant even though students 
appear to be "engaged.** Students often are poorly prepared for 
seatwork assignments (teachers fall to provide students with an 
adequate rationale or motivation for doing the work or do not give 
students adequate procedural directions or sufficient Information 
about the concept being studied), are assigned tasks that fill time 
but do not logically extend students* understanding of suhject matter 
content, and are not given evaluative feedback about class work 
(Doyle. 1982). Under such conditions one would not expect t1ffleH)n- 
task to predict student achievement. 

It is also the ca'.'e that sometimes students' apparent engagement 
can be misleading. Peterson and Swing (1982) Interviewed students 
who had .been taught a lesson pn probability. They found that some 
students who appeared to be paying attention to lectures or class 
discussions were actually thinking about other things, such as how 
they would perform In comparison to other pupils if they were called 
on. Peterson dnd Swing found ^.lat attending as measured by a 
student's response to an Interview was a better predictor of achieve- 
ment than attending measures based on classroom observations. Other 
reiearchers have also demonstrated the need to study the quality of 
students' cognitions as well as their direct task behavior 
(Rohrkemper & Bershon, in press). 

Given these problems with time measures, why then do they relate 
to student achievement? It appears that time measures do consistent- 
ly relate to student achievement but that this relationship is not 
dlwdys substantial (although these reldtionships are positive and 
range from weak to moderate). As has been argued elsewhere (Good & 
Hinkel, 1982) it is likely that measures of engaged time tend to show 
at least some correlation with student achievement because even 
superficial task involvement suggests that (a) tn<i teacher possesses 
minimdl mandgeridl skills, (b) the teacher has negotiated some com- 
pliance with students, (c) there Is some appar * jreed upon direc- 



tlon and purpose in the class, and (d} at least some of the time 
students reflect upon assigned work. 



ImpHcations of Research on Tiae 

It noM seems clear that the same amount of learning time can 
have dramatically different conseijuences, depending upon classroom 
and Individual student factors,, and that learning depends upon both 
student attention and appropriate instruction. Theories of classroom 
learning (and subsequent studies of time and learning) should be 
based more on accommodating student diversity in ability and on 
quality of instruction rather than on allocated time per se. This 
dynamic view of learning assumes that factors affecting classroom 
learning vary over time (e.g., student interest, instructional pacf) 
and that on-going events In classrooms affect this variation (e.g., 
student composition factors, specific subject matter assignments). 
Time spent on academic tasks Is important, but quality of the time 
expenditure is more important. More research is needed to understand 
Issues associated with quality. 



Classroom Management 

In the 1960's it was popular to view classroom management as 
classroom discipline and considerable emphasis was placed upon what 
to do after students misbehaved. A research paradigm initiated by 
Kounin (1970) and validated and expanded upon by a number of 
researchers in the past few years has strongly illustrated that good 
classroom managers are not sharply differentiated in terms of how 
they react to student mTsFehavior. Rather, the key behaviors that 
distinguish good classroom managers are techniques which prevent 
misbehavior by eliciting student cooperation and involvement in 
assigned work. 

Kounin (1970) found that withitness, momentum, alerting, accoun- 
tability, and overlapping were all positively and at least moderately 
correlated with student involvement in classroom lessons. Kounin's 
basic findings have been expanded somewhat. For example, researchers 
have subsequently noted that teachers can alert or engage in too much 
accountability as well as too little. Fundamentally, however, 
Kounin's work has been consistently *epHcated by follow-up research 
and remains an important source of information about classroom 
mdnagement , 

Einmer, Evertson, and Anderson (1980) studies 27 third-grade 
teachers du»-ing the first week of school as well as throughout the 
remainder of the year. These investigators attempted to identify 
teachers who had comparable classes at the beginning of the year but 
differed in their management effectiveness (degree of student 
involvement in lessons) during the year. The findings of this study 
suggest that the form of the management system is not as important as 
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the qua! i ty i»Uh which it Is iaplemented. The authors found thdt 
^hat distingui shed the store effective managers was the degree to 
which the rules and procedures were Integrated Into a workable system 
and how effectively the systesi was taught to students. The effective 
managers were superior primarily because of their clear expectations, 
commitment to teach these classroom routines, and their systematic 
follow-through. 

Evertson and Anderson (1979) report that better nanagers were 
also more careful monitors of student behavior and dealt with mis- 
behavior more quickly than less effective managers. Wore effective 
managers alerted f tudents to the behaviors they expect and held 
students accountable for those behaviors. To the extent that 
students lnternal.lzed these rules, tl^ could monitor their own 
behavior more continuously (e.g., they knew when and how to get help 
from other students about missed assignments). Communicating class- 
room norms for conduct and procedures not only makes the Individual 
learner more efficient (e.g., minimal time wondering about when or 
how CO approach the teacher for feedback). It also minimizes the 
numuer of situations that demand complex management skills. 



Why Proactive Hanagement Works: Toward a Theory 

Teachers who are successful managers start the year by 
establishing rules and procedures and by communicating expectations 
for classroom behavior. Other teachers who are ambiguous about their 
behavioral expectations spend much time attempting to clarify expec- 
tations. Students in these teachers' classes may spend considerable 
time wondering (sometimes justly sd) whether their behavior Is 
inappropriate or not. In effective managers' rooms It Is thus easier 
to Know whdt is expected; and it is easier for students and teachers 
to monitor classroom behavior because they can distinguish appro- 
priate from inappropriate behavior. 

It Is important that teachers who establish rules actively 
monitor and deal with inappropriate behavior (especially serious 
misbehavior). Effective managers may therefore sanction more 
behavior during the first three or four days of the year than do 
other teachers. Because students eventually begin to engage in fewer 
off -task behaviors, it soon becomes even easier for the teacher to 
monitor the c'ass (few disruptions to attend to) and to sanction 
behavior appropriately (e.g., correct the right student for his/her 
misbehavior). Failure to follow up on inattentive, disruptive 

VI or suggests to students that the teacher is not serious about 
maintaining rules and such behavior encourages r^tudents to do as they 
please. Similarly, a teacher who consistently reprimands the wrong 
student (e.g.. a student wh& did not misbehave or a student who 
joined but did not initiate the misbehavior) indicates to students 
that he/she does not have the skills to maintain a management system 
(why not mi^^.behave If you're as likely to be sanctioned for mis- 
behavior when attending to assigned tasks as you are when actually . 
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misbehaving?)- If teachers exhibit a lack of purpose, and/or a lack 
of Interest In maintaining a management system. It Is likely that 
students w1>1 ignore the teacher and classroom rules much of the 
time. 

If teachers establish reasonable and workable rules, hold posi- 
tive expectations for student participation In those rules, and 
Insist upon appropriate behavior when necessary, I believe that 
students will understand the teacher's seriousness and purposeful ness 
about classrooii. management and will begin to internalize classroom 
rules, expectations, and procedures. 

In addition to establishing procedural and behavioral expecta- 
tions, teachers must also demand that students use their time to 
complete curriculum tasks. Effective managers assume that students 
will complete assignments and hold students accountable for work. 
Students know what to do when they finish assignments and do not 
waste time trying to determine the next step. That is, effective 
managers construct classroom environments In which expectations for 
stujent behavior are continuous. 

In some classrooms teachers make it difficult for students (as 
well as teachers) to monitor their own behavior. For example, 
following a demonstration lesson such a teacher might assign seatwork 
but say, "If you work now you won't have homework." Such statements 
and expectations make students' classroom role ambiguous. Pre- 
sumably, students can do the work now or later. Hence, when students 
choose not to do seatwork it is difficult to tell if their behavior 
Is appropriate or inappropriate. Furthermore, there is the question 
of what these students will do while other pupils are likely engaged 
In seatwork. 

In contrast, more effective managers are likely to make a tran- 
sition from demonstration to seatwork in the following way. "Now you 
do problems 15-30 at your desks. In ten minutes we will check to see 
what progress you have made and correct any problems we encounter. 
If you have difficulty with a problem do the next one and I'll be * 
around to help you. Get started now." Here the students' role is 
clear; under all conditions they should be attempting to do assigned 
work,.,even if they encounter difficulty they know to proceed to the 
next problem. 

In essence, a good management system announces intentions and 
makes it possible to actively monitor teacher and student behavior to 
see if progress is being made in shared goals. Such information 
ircreases the understanding of students who are intrinsically moti- 
vated by school tasks and of teachers concerning how to proceed and 
do well in the classroom. A management system helps to establish the 
conditions necessary for students without these orientations to learn 
self-control and to engage in acao nic tasks. These students come to 
understand that classroom rewards and privileges are associated with 
personal progress on assigned tasks. Without highly developed 
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mdnagement skUls d teacher will rely on simplistic and routine 
assignments which elicit cooperation from students (Doyle, 1982). 

As students become older, there should be less need for teachers 
to remind them of what behavior Is appropriate. Still, students at 
all ages should have an umterstandlng of what constitutes appropriate 
work and behavior. Students also need feedback about their progress 
on self -chosen goals as well as Informatlcm on goals established by 
the teacher. After students have developed appropriate learning 
expectations and Independent work skills (they believe they can do 
assigned seatwork, know when they are confused, and know how to 
obtain Information), then teachers can reasonably require students to 
work more Independently (students work for extended time periods 
without feedback) and assi^ them more complex tasks (projects that 
do not. have one acceptable answer). 

Good management skills provide a necessary, but not sufficient, 
structure for active classrocm learning. I believe that poorly 
managed classes inhibit students' involvement in the instructional 
program and negatively affect learning outcomes. The correlational 
evidence relating the management behaviors reviewed here to student 
achievement is v-ry consistent and the obtained relationships are 
typically at least moderate (Brophy, 1983). Furthermore, there is 
increasing experimental evidence that the managerial principles dis- 
cussed above can be taught to teachers, who can use them to improve 
student attention to assigned work (e.g., Anderson, Evertson, & 
Brophy, 1979; Brophy, 1983; Good, Grouws, & Ebmeier, 1983). 

.lecent research on management is important but It, like the 
research on time, yields guidelines not answers. A good Illustration 
of the potential problem with blind application of findings can be 
seen In data reported by Doyle (1983). He found that it was possible 
to identify some teachers who were poor managers (using process- 
product research criteria) but who obtained high student achievement. 



Teacher Expectations 

Mucn of the research conducted in the 1970's consisted of class- 
room observational studies aimed at determining what teachers do in 
their interactions with high- and low-achieving students. The extent 
to which teachers differentiate in their behavior toward students has 
been found to represent an individual difference variable, with some 
teiichers varying their behavior more than others (Brophy & Good, 
19/4; Cooper & Good, 19S3). 

Although the causes of differential interaction are not 
definitely established, it is clear that many teachers vary sharply 
in their interaction patterns with high- and low-achieving students. 
Teachers differentiate their behavior toward students they perceive 
<js high or low achievers in a variety of ways, (See Appendix 1 for a 
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Hst of some of the more coraroon behavior. For a comprehensive dis- 
cussion of these variables, see Good & Brophy, 1978, 1984), 

Data from the extensive empirical and conceptual work In the 
area of teacher expectations research do not yield rules concerning 
teacher behavior toward high and low achievers, it Is Important to 
accept the fact that teachers can expect too rouch or too ^<ttle In 
their Instructional assignment Interactions with students. This 
dilemma also has to be addressed by curriculum specialists who write 
textbooks and by policymakers. There are many Instances In which 
teachers need, for example, to^assl^ different types of material to 
high and low achievers. Teachers can also make instructional mistakes 
by treating students too much alike, as we41 as too differently. 
Observational studies of classrooms suggest that the problem varies 
from classroom to classroom. Hence, simple rules like increase "wait 
time" for "lows'* will do more harm than good (1.e., some teachers are 
already waiting an appropriate length of time). 

As I point out elsewhere (Good, 1983, in press), because the 
variables that affect teaching and learning ar? numerous, complex, 
and interrelated, knowledge of concepts related to teacher expecta- 
tion effects is best provided along with judgmental and decision^ 
^^aMng skills about its appropriate use. Teachers should not be 
given a list of behaviors they need to routinely perform. Informa- 
tion about expectation effects has to be combined with extensive 
knowledge about how children learn as well as knowledge of child 
development if such information is to i>e used appropriately. 



Teacher Effectiveness Research: Active Teaching 

Concern with dt teachers actually do in the classroom led many 
researchers to focus on how teachers interacted with high- and low- 
achieving students. An incidental outcome of this research was the 
demonstration that teachers vary greatly across classrooms in their 
behavior, as well as in how they distribute their time and resources 
within classrooms. 

Our initial research on this problem began with a sample of over 
100 third- and fourth-grade teachers. Looking at test scores over a 
3-yedr period, we found l*iat teachers varied considerably in their 
impact on students' learning, despite the fact that they were using 
the same textbook and in most cases were teaching comparable 
students. Our initial data were a demonstration of an apparent 
teacher effect. Some teachers produced much more mathematics learn- 
ing than did other teachers teaching in comparable settings. 

We felt that observing teachers who had a stable and relatively 
high or low level of effectiveness would be an excellent basis for 
estimating the relative value of different teaching behaviors. 
Hence, our observational research focused upon teachers who were 
consistently high and low across several consecutive years in their 
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ability to produce student performance on standardized achievement 
tests. We found that statute, nigh and low teachers differed In their 
classroom behavior (for details see fiood. GrouMS. & Etoeler, 1983). 

Although we were pleased with the naturalistic findings In that 
they provided some cle^r contrasts between relatively high and low 
gain classrooms, we felt that It was Important to determine whether a 
more direct association could be established between the behaviors 
that were Identified In our observational, naturalistic study and 
student achievement. 

In particular, we wanted to see If we could Instruct teachers to 
behave In ways consistent with tte behavior of high gain teachers and 
to determine what. If any. Impact such behavior would have on student 
achievement. Because of the expense Involved In field testing the 
program, we wanted It to be as comprehensive as possible. Thus, In 
addltlon^to Including the contrast obtained In our earlier naturalis- 
tic studies, we tested some of the promising findings from other- 
teacher effectiveness studies as well as our understanding of what 
some effective teachers were doing. That Is, we were not tied com- 
pletely to the group average obtained In the naturalistic study. 
Writing the training program resulted in a 45-page manual for 
teachers. The program, as pointed out elsewhere (Good & Grouws, 
1979), is a system of instruction; (a) instructional activity is 
iniiiated and reviewed in the context of meaning; (b) students are 
prepared for each lesson stage to enhance Involvement and to minimize 
errors; (c) the principles of distributed and successful practice are 
built into the program; (d) active teaching is demanded, especially 
in the developmental portion of the lesson (when the teacher explains 
the concept being studied, its importance, etc.). See Appendix 2 and 
3 for an example of the organizational structure associated with the 
program (for complete details of the training program see tood, 
Grouws, & Ebmeier, 1983). 

Pre- and post-testing with the standardized achievement and 
content referenced tests indicated that after 2 1/2 months of the 
program, the performance of students in experimental classrooms was 
considerably higher than those in control classrooms. It was also 
found that experimental students reported significantly more favora- 
ble attitudes at the end of the experiment than did control students. 
Also, research at the junior high level suggests that secondary 
teachers can implement the program with positive impact on certain 
aspects of students' mathematics achievement (Good, Grouws, & 
Ebmeler, 1983). 

Uur research on mathematics instruction, especially at the ele- 
mentary school level, has convinced us that teachers do make a 
di f ference In student learning, and that inservice teachers can be 
trained in such a way that student performance can be increased. The 
system of instruction that we see as important can be broadly charac- 
terized as active teaching. It is instructi to note that In our 
experimental work active teaching was an important difference between 
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teachers who Mere getting good acli1evem«at gains and those Mho were 
getting lower-than -expected gains. Teachers vrhose students made 
higher gains were much fnore active in presenting concepts, explaining 
the meanings of those concepts^ providing appropriate practice acti-' 
vities, and monitoring those activities prior to assigning seatwork. 
The fact that these teacimrs appeared to look for ways to confirm or 
disconfirm that their presentations had been comprehended by students 
was particularly Important. They assumed partial responsibility for 
student learning and appeared to be ready to reteach when necessary. 

In contrast, teachers who were getting lower gains tended to 
rely much more on seatwork activities and often their students were 
doing work without a good conceptual understanding of what they were 
doing and why. In some cases students did not receive adequate 
procedural instructions for seatwork and teachers appeared to ignore 
signs from students that indicated either procedural or substantive 
misunderstanding. 



Qual ifications 

One important consideration is that in a variety of studies 
using the Missouri Mathematics Program* dxperiraental groups have done 
better than related control groups. However, the magnitude and 
importance of the differences are more evident for some teacher and 
student combinations than others. It is clear that certain types of 
students and teachers together tend to do better using the treatment 
than do other combinations of students and teachers (Ebmeier & Good, 

1979) . The effects of the program on some teacher -student combina- 
tions have been replicated by Janlcki and Peterson (1981). It also 
seems that the classroom organizational structure interacts with the 
effects of the instructional treatment (Ebmeier, Good, & Grouws, 

1980) . 

It should be evident that there is no single system for pre- 
senting mathematics concepts effectively {organizational structure 
does not predict effectiveness). For example, some of the control 
teachers in our studies have obtained high levels of student achieve- 
ment using instructional systems that differ from those presented in 
the program we have developed. More information about the classroom 
contexts and particular combinations of teachers and students that 
make the program more or less effective is needed. Research on other 
outcome measures such as problem solving and estimation should also 
be conducted (see Reys S Bestgen, 1981 for a good discussion of 
estimation skills), and it is important that outcomes other than 
subject-matter mastery be explored as important events per se in 
dddition to seeing If gains in achievement come at the expense of 
other important outcomes (for a good discussion on teaching self- 
control see Anderson & Prawat, 1983). 

Still, it is satisfying to see that the instructional program we 
have developed (and programs developed by others) seems to be a 
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vUble sj^stesi that teachers are wlUIng to Implement, aftd that It 
positively influences stu<lent achievement. We now need to know much 
more about why sobw teachers Implement the system more extensively 
than others and what local school features (Including student charac- 
teristics and classrot^ structure) lead to greater levels of Imple- 
mentation, In particular. It will be necessary to stu^y both 
naturalist leal ly and experimentally mathematics teachers who use 
Individualized and small -group practices more successfully than do 
other teachers. 

I suspect that many aspects of the model will be present in 
individual lied and small -group organizational structures; however, 
some new format variables will likely emerge from such studies. 
Research on teacher eff^tlveness In other organizational structures 
will clearly be of considerable value In theory building, and also In 
understanding wr^y certain patterns of classroom process are helpful 
for certain students as they learn particular concepts. 



Specific Teacher Behaviors 

This section of the paper Is drawn from a comprehensive review 
of the literature (Brop^v & Good, in press) and summarizes some of 
the more specific conclusions that can be drawn from the extant 
literature about teacher behaviors that maximize student achievement. 
These conclusions are presented first as three general aspects of 
teaching and then information for handling specific lesson parts is 
discussed. However, it Is important to emphasize again that these 
conclusions cannot be equated with teacher effectiveness. 



Quantity and Pacing of Instruction 

The most com i stent ly replicated findings link achievement to 
the quantity and pacing of instruction. Amount learned is related to 
opportunity to learn, whether measured in terms of text pages covered 
or percentage of test items taught through lect4»re or recitation. 
Opportunity to learn is determined in part by length of school day 
and school year, and in part by the variables discussed below. 

Role defi nit ion/expectations/time allocation. Achievement is 
maximized when teachers emphasize academic instruction as a major 
part of their role, expect students to master the curriculum, and 
allocate most of the available time to curriculum-related activities. 
This is seen in relationships involving measures of teachers' role 
definitions and expectations, high-inference ratings of the degree to 
which teachers are businesslike or task-oriented, and low-inference 
measures of time allocated to acactemic activities rather than to 
activities with other objectives. 

Classroom management/student engaged time, hot all time allo- 
cated to academic activiti * is actually spent engaged In these 
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activities. Engagement rates depend on the teacher's ability to 
organize and manage tlie classroom as an efficient learning environ- 
ment where academic activities run smoothly, transitions are brief 
and orderly, and little time Is spent getting organized or dealing 
with 1nattent1<si or resistance, as noted earlier In this paper. Key 
Indicators of effective management Include: goiMl preparation of the 
classroom and Installation of rules and procedures at the beginning 
of the year, withltness and overlapping In general Interaction with 
students, smoothness and momentum In lesson pacing, variety and 
appropriate fevel of challenge In assignments, consistent accounta- 
bility procedures and follow-up concerning seatwork, and clarity 
about when and how students can get help and about what options are 
available when they finish. Exten(ted practical discussions of these 
variables are presented elsewhere (Good & Brophy, 1984). 

Consistent success/academic learning time. To learn 
efficiently, students must be engaged in activities that are appro- 
priate in difficulty level and otherwise suited to their current 
achievement levels and needs. It Is Important not only to maximize 
content coverage by pacing the students briskly thr(High the currl*- 
culum, but also to see that they make continuous progress all along 
the way, moving through small steps with high rates of success and 
minimal confusion or frustration. If lessons are to run smoothly 
without loss of momentum and students are to work on assignments with 
high levels of success, teachers must be effective In diagnosing 
learning needs and prescribing appropriate activities. Their ques- 
tions must usually yield correct answers (about 75% of the time) and 
seldom yield no response at all, and seatwork activities must be 
completed with 90 to 100% success by most students. Appropriate 
seatwork will extend knowledge and provide needed practice, but it 
Mil! also be "doable" because it Is at the correct difficulty level 
dnd because students have been prepared for it. Thus, the high 
success rates result from effort and thought, not mere "automatic" 
application of already overlearned algorithms. Continuous progress 
at high rates of success, carried to the point that performance 
objectives can be met smoothly and rapidly, is especially Important 
in the edr]y grades and whenever students are learning basic 
knowledge or skills that will be applied later in hfgher-level 
dcti vUies; 

Active teaching. Students achieve more in classes where they 
spend most of their time being taught or supervised by their teachers 
rather than working on their own (or not working at all). These 
classes include frequent lessons (whole-class or small-group, 
depending on grade level and subject matter) in which the teacher 
presents information and develops concepts through lecture and demon- 
stration, elaborates this information in the feedback given following 
responses to recitation or discussion questions, prepares the 
students for follow-up seatwork activities by giving instructions and 
going through practice examples, monitors progress on assignments 
after releasing the students to work independently, and follows up 
with appropriate feedback and reteaching when necessary. The teacher 
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conveys tne content to the students rattier than dependlns on the 
curriculum materials to do so, but conveys Information mostly in 
brief presentations followed by recitatiiK) or application opportuni- 
ties. There is a great deal of teacher talk, but most of It is 
academic rather than procedural or managerial, and much of it 
Involves asking questions and giving feedback rather than extended 
lecturing. 

The findings summarized above deal primarily with quantity of 
academic activity, particularly the time spent in organized lessons 
':ind supervised seatwork. The following variables concern the form 
and quality of teachers' organized lessons. 



Giving Information 

Variables of lesson form and quality can be divided into those 
which Involve giving information (structuring), asking questions 
(soliciting), and providing feedback (reacting). The following vari- 
ables apply to the function of giving 'Information. 

Structuring. Achievement is maximized when teachers not only 
actively present material, but structure it by: beginning with 
overviews, advance organizers, or review of objectives; outlining the 
content and signaling transitions between lesson parts; calling 
attention to main ideas; summarizing subparts of the lesson as it 
proceeds; and reviewing main ideas at the end. 

Redundancy/sequencing. Achievement is higher when information 
is presented with a degree of redundancy, particularly in the form of 
repeating and reviewing ^neral rules and key concepts. In general, 
structuring, redundancy, and sequencing affect what 1? learned from 
listening to verbal presentations, even though they are not powerful 
determinants of learning from reading text. 

Clarity. Clarity of presentation is a consistent correlate of 
achievement, whether measured by high-inference ratings or low- 
inference indicators such as absence of "vagueness terms'* or "mazes." 
KfTOfJedge about factors that detract from clarity needs to be supple- 
mented with knowledge about positive factors that enhance clarity, 
but In any case, students learn more from clear presentations than 
from unclear ones. 

Enthusiasm . Enthusiasm, usually measured by high -Inference 
ratings, appears to be more related to affective than to cognitive 
outcomes. Nevertheless, It often correlates with achievement, 
especially for older students. 

Paclng/walt-tlme. "Pacing" usually refers to the solicitation 
aspects of lessons, but It can also refer to the rate of presentation 
of information during Initial structuring. Although few studies have 
addressed the matter directly, data from the early grades seem to 
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fdvor rapid pacing, both because this helps maintain less(m momentum 
(and thus minlifiizes Inattention) and because such pacing seems to 
suit the basic skills learning that occurs at these grac*e levels. 
Typically, teacher presentations are short and Interspersed with 
recitation or practice opportunities. At higher grade levels, how- 
ever, where teachers make longer presentations on more abstract or 
complex content, It may be necessary to move at a slower pace, 
allowing time for each new concept to "Sink in/ 



Questioning the Students 

The variables In this section concern the teacher's management 
of public response opportunities during recitations and discussions. 

Difficulty level of questions. Data on difficulty level of 
questions continue to yield mixed results. It seems clear that most 
(perhaps three-fourths) of teachers' questions should elicit correct 
answers, and that most of the rest should elicit overt, substantive 
responses (incorrect or incomplete answers) "-ather than failures to 
respond at all. Beyond these generalities, optimal question diffi- 
culty probably varies with context. Basic skills instruction re- 
quires a great deal of drill and practice, and thus frequent fast- 
paced drill /review lessons during which most questions are answered 
rapidly and correctly. However, when teaching complex cognitive 
content or when trying to stimulate students to generalize from, 
evaluate, or apply their learning, teachers will need to raise ques- 
tions that few students can answer correctly (as well as questions 
that have no single correct answer). 

Cognitive level of questions. The cognitive level of a question 
is conceptually separate from its difficulty level. Extant data 
refute the simplistic (but frequently assumed) notion that higher- 
level questions are categorically better than lower-level questions. 
Several studies indicate that lower-level questions facilitate 
'learning, even learning of higher-level objectives. Furthermore, 
even when the frequency of higher-level questions correlates 
positively with achievement, the absolute numbers on which these 
correlations are based typically show that only about 25% of the 
questions asked were classified as higher level. Thus, In general, 
we should expect teartiers to ask more lower-level than higher-level 
questions, even when dealing with higher-level content and seeking to 
promote higher-level objectives. 

Clarity of questions. Teachers can train students to answer by 
snowing a willingness to wait for the answer; however, clarity of 
question is also a factor. Students sometimes cannot respond because 
questions are vague or ambiguous, or because the teacher asks two or 
more questions without stopping to get an answer to the first one. 

Post -quest ion wa1t-»1me. Studies of science instruction have 
shown that students achieve better when teachers pause for about 
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tnree seconds (rather- tttan ooe second or less) after questions, to 
give the students time to think before calling on one of them. This 
variable has not been addressed In other contexts. It seems lUely. 
however, that length of pause following questions should vary 
directly with their difficulty level and especially their complexity 
or cognitive level. , A question calling for application of abstract 
principles should require a longer pause than a factual question. 

Waiting for students to respond. Once teachers do call on 
students {especially non volunteers), they usually should wait until 
the students offer a substantive response, ask for help or clarifica- 
tion, or overtly say "I don't know.** Sometimes, however, especially 
in whole -class lessons where lengthy pauses threaten continuity or 
momentufn, it will be necessary for the teacher to curtail the pause 
by making a response. 



Reacting to Student Responses 

Once the teacher has asked a question and called on a student to 
answer, the teacher then must monitor the student's response {(or 
Idck of it) and react to to. 

Reactions to correct responses. Correct responses should be 
acknowledged as such because, even If the respondent knows that the 
answer is correct, some of the onlookers ma;' not. Ordinarily 
{perhaps 90% of the time) this acknowledgement should take the form 
of overt feedback which may range from brief head nods through short 
affirmation statements ("right," "yes") or repetition of the answer, 
to more ext2nsive praise or elaboration of the answer. 

Reacting to partly correct responses. Following responses that 
are Incomplete or only partly correct, teachers ordinarily should 
affirm the correct part and then follow up by giving clues or 
rephrasing the question. If this doe% not succeed, the teacher can 
vjive the answer or call on another student. 

Reacting to incorrect responses. Following incorrect answers, 
teachers should begin Dy indicating that the response is not correct. 
After indicating that the answer was Incorrect, teachers usually 
Should try to elicit an Improved response by rephrasing the question 
or giving clues. Such response improvement attempts are likely to be 
facil native when they are generally successful, but teachers should 
4vy)d "pointless pumping" in situations where questions cannot be 
broken down or the student Is too confused or anxious to profit from 
further questioning, 

Sometimes the feedback following an incorrect answer should 
include not only the correct answer but a more extended explanation 
of why the answer is correct or how it can be determined from the 
information given. Such extended explanation should be included in 
the feedback whenever the respondent (or others In the class) might 
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not "get the i^lnt" from tearing the answer a1one» as well as at 
times when a review or summarjr of part of the lesson Is needed. 



Reacting to "no response^ Teachers should train their students 
to respond overtly to questions, even if only to say don't know." 
Thus, If waiting has not produced an overt response, they should 
probe ("Do you know?"}, elicit an overt response, and then fullow up 
by giving feedback, supplying the answer, or calling on someone else 
(depending on the student's response to the probe). 

Reacting to student questions and comments. Teachers should 
answer relevant student qt^stions or redirect them to the class, and 
Incorporate relevant student comments Into the lesson. Such use of 
student Ideas appears to become more Important with each succeeding 
grade level, as students become both more able to contribute useful 
fdeas and more sensitive to whether teachers treat their ideas with 
interest and respect. 



Handling beatwork and Honwwork Assignments 

Although independent seat work Is probably overused and Is not a 
substitute for active teacher Instruction or for drill /recitation/ 
discussion opportunities, seatwork (and homework) assignments provide 
needed practice and application opportunities. Ideally, such assign- 
ments will be varied and interesting enough to motivate student 
engagement, new or challenging enough to constitute meaningful 
learning experiences rather than pointless busywork, and yet easy 
enough to allow success with reasonable effort. 

Students should know that work they ate accountable for, how to 
get help when they need it, and what to do when they finish. Per- 
formance should be monitored for completion and accuracy, and 
students should receive timely and specific feedback. If the whole 
class or group has the same assignment, review of the assignment can 
be part of the next day's lesson. Other assignments will require 
more individualized feedback. If performance is poor, teachers 
should provide not only feedback but reteaching and follow-up assign- 
ments designed to insure that the material is mastered. 



Cone iusion 

First, we can conclude that recent classroom research has pro- 
duced rich empirical findings and concepts that have considerable 
potential to affect classroom practice. In the last decade resear- 
chers have produced direct evidence to refute the myth that teachers 
do not make a difference. This is important information in relation 
to policy, because it indicates that teachers are a vital Investment. 
Furthermore, we have gained new models for analyzing instruction, 
models that are valuable to practitioners. However, we need to know 
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much wore about the quality and comblnatlohs of teaching processes 
that are associated with Increases in student achievement. 

A second conclusion Is that recent classroooi research findings 
need to be systematically disseminated In teacher education programs, 
although such 1nformat1<m sNmld be pres^ted in a ^tslon-oaklng 
format that enables stuitents to axamlne concepts and to apply them to 
unique settings (for a good Illustration of this Idea, see Amarel, 
1981 and Good & Brophy ig78, 1984}. Teacher training programs should 
not encourage students to make literal and unalterable Interpreta- 
tions of concepts and research findings. We know that there can be 
too much as well as too little alerting or accountability (or any 
other variable). 

To articulate and successfully Implement a teacher education 
program that carefully combines process skills, research Insights, 
and subject matter knowledge that enables teachers to become active 
decision makers Is In Itself a massive step that merits systematic 
study. Translation of research findings Into recommendations for 
practice Is a very difficult task and one which Is often Ignored In 
teacher education programs. Still, we must convey to teachers that 
learning Is problematic because classroom problems and contexts vary. 
Teachers must also know that concepts and findings from research 
yield greater awareness of problems and alternative ways for solving 
them, but do not offer answers to educational problems. 

A good example of the need to use c1assro(»Q research findings as 
tools rather than answers can be seen In Mms and Biddle's (1970) 
discussion of the "action zone." They found that students who sat In 
the middle-front-row seats and In seats extending directly up the 
middle aisle received more opportunities to talk In class than did 
other students. This research Is valuable, and It suggests that 
there may be areas of a classroom where students receive more 
response opportunities than students In other areas, ftowever, this 
study could be Interpreted too literally, as Implying that teachers 
and/or classroom observers should pay most attention to what takes 
place In the front row and the middle of a classroom. 

Recent data collected by Alhajrl (1981) show the utility of 
viewing the action zone as a concept rather than a generalized pheno- 
menon. In 32 classrooms the investigator found only one that had an 
action zone like that described by Adams and Biddle; however, Alhajrl 
found many classrooms In which some kind of action zone was present. 
If observers or teachers were monitoring classes for only one type of 
action zone, they would not have perceived the action zones that were 
present In these classrooms because they took a different form. 

A third general conclusion deils with consolidating and enhan- 
cing progress In classroom research through new research. I believe 
that research needs to become more comprehensive than It has In the 
past. Past research has examined single variables of schooling such 
as the curriculum, or teachers, or students. As stated earlier. If 
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research <s to be effective, 1t$ context must be focused. However, 
«Uti1n the particulars of a single study (e«9o middle school science 
classes), research needs to become nore comprehensive. If classroom 
learning Is to be Improved and/or understood, future studies must 
describe the concepts and subject «Mtter Issues being examined as 
well as how teachers and students thinK and behave when they study 
these concepts! FTnally, I believe that we must consider more 
seriously the meanings of findings and their relationship to practice 
than we have traditionally done* We must attempt to understand as 
well as to describe and to generate theories and explanations as 
well as concepts and findings. 



ERIC 



126 

135 



\ APPENDIX 1 



C(mffllCA\|ON OF LOW EXPECTATIONS 



1. CdUIng Oft lows )ess ofteit to answer classroora questlofis or 
make prblU deaionstratlons, 

2. Wdlting less time for lows to answer questions. 

3. Praising lows less frequentljf than highs after successful public 
responses . 

4. Criticizing lows more frequentljf than highs for Incorrect public 
responses* 

5. Not staying with lows In failure situations (providing clues, 
asking follow-up questions). 

6. Seating slow students farther from the teacher or in a group 
(making it harder to monitor low-ach1ev1ng students or treat 
them as individuals). 

7. Paying less attention to lows in academic situations (smiling 
less often and maintaining less eye contact). 

8. Praising lows more frequently than highs for marginal or 
inadequate public responses. 

9. Providing low-achieving students with less accurate and less 
detailed feedback than highs. 

10. Falling to provide lows with feedback about their responses more 
frequently than highs. 

U. Demanding less work and effort from lows than from highs, 

12. Interrupting the performance of low achievers more frequently 
than that of high achievers. 

13. Organizing assignments for lows around drill and practice in 
contrast to the organization of assignments for highs around 
meaning and concepts. 



For additional information about the ways in which teachers communi- 
cate expectations to students, see Good, T. and Brophy J. Looking in 
classroom . New York: Harper i Rowe. 
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APPENDIX 2 



SUMMARY OF KEY INSTRUCTIONAL BEHAVIORS 



Oilly Review (first 8 minutes except Mondays) 

1. Review the concepts and skills associated with the homework. 

2. Collect and deal with homework assignments. 

3. Ask several nental computation exercises. 

Bevel o n i ent (about 20 minutes) v. 

1. Briefly focus on prerequisite skills and concepts. 

2. Focus on meaning and promoting student understanding by using 
lively explanations* demonstrations , process explanations, 
illustrations, etc. 

3. Assess student comprehension 

a. Using process/product questions (active Interaction), 

b. Using controlled practice. 

4. Repeat and elaborate on the meaning portion as necessary. 

Seatwork (about 15 minutes) 

1. Provide uninterrupted successful practice. 

2. Momentum— keep the ball rolling —get everyone Involved, then 
sustain Involvement, 

3. Alerting'-let students know their work will be checked at end of 
period. 

4. Accountabil 1ty--check the students' work. 
I hi! work Asslgmmt 

1. Assigning on a regular basis at the end of each math class except 
Fridays. 

2. Should involve about IS minutes of work to be done at home. 

3. Should include one or two review problems. 

Special Review 

1. Weekly review/maintenance 

a. Conduct during the first 20 minutes each Monday. 

b. Focus on skills and concepts covered during the previous 
week. 

2. Monthly review/maintenance 

a. Conduct every fourth Monday. 

b. Focus oil skills and concepts covered since the last monthly 
review. 
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' ' Teaclwrs need a clear idea of what Miavbrs are and are not appro- 
priate in ttmr classrooms. Wfthout mjch expectati<yis, they are sut^t 
to the behavk>ral kiiosyncracies of particular students, they mn me risk 
of txing inconsistent, and they may aHow t)ehavbrs to tie estat^ished 
that are inccmpat^e with prodix:ti)m of cla^room time." 



' 'Identifying expectations for t)ehavbr is not simply a m utter of listing a 
set of rules for students. Instead, it involves a process of conceptualizing 
the nature of activitbs that will occur in ttie classroom and identifying 
how students sttould tjehave in these activities in onjer for a smoothly 
functioning class to occur" 
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CURRENT RESEARCH ON EFFECTIVE CUSSROiM MANAGEMENT 



EdDiund T. Emner 
Research and Development Center 

for Teacher Education 
The University of Texas at Austin 



This presentation* will give an overview of research on class- 
roois management* emphasizing results from a program of research 
conducted at the Research and Development Center for Teacher Educa- 
tion during the past § years. These studies, along with other 
Investigations of classroom management t provlcte a basis for 
describing Important dimensions of teact^r behavior that account for 
well -managed c1assro(HBS» It should be emphasized that this Is an 
overview, not a complete (tescrlptlon of all classroom management 
tasks. Thoughtful perspectives on managing classrooms can be found 
In books edited by Duke (197g, 1982) and In a paf^r by Brophy (1983). 
Detailed descriptions of skills for managing elementary classrooms 
can be found in Evertson, Emmer, Clements, ^nford, and Uorsham 
(1984); and for secondary classrooms. In Emmer, Evertson, Sanford, 
Clements, and Worsham (1984). 

We began studying classroom management for several reasons. One 
was that process/product research conducted at our Center (e.g., see 
Brophy & Evertson, 1975) had Identified effective classroom manage- 
ment as a consistent predictor of student achievement. To Illus- 
trate, consider the results of one analysis of a study of 29 seventh- 
and eighth-grade math teachers (Evertson, Emmer & Brophy, 1980). For 
this analysis, a subset of three highly effectlvf teachers and six 
relatively ineffective teachers was Identified t>ased on student 
learning gains over the course of a year on a district-administered 
achievement test and on the basis of student attitudes as measured by 
d questionnaire given ^t the end of the school year to each teccher's 
students. Extensive observation data were obtained in each class by 
observers who had no knowledge of any results regarding student 
achievement or attitude. A comparison of the two sets of teachers on 
classroom behavior measures indicated numerous significant mean 
differences (p < .05). Examples of variables are listed below: 

-* This presentation is based on the author's report: Classroom 
Management: Research and Implications (R&D Report No. 6178), Austin: 
Research and ueveiopment Center for Teacher Education, The University 
of Texas at Austin, November, 198^ The preparation of the report 
Mas supported in part by the Research and Development Center for 
Teacher Education, which Is funded by the National Institute of 
Education. The opinions expressed herein do not necessarily reflect 
the position or policy of the National Institute of Education or the 
Research and Development Center for Teacher Education, and no 
endorsement should be inferred. 
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Teacher consistently enforces rules; 
Amount of disturbance teacher accepts; 
Monitoring of class; 
Efficiency of transitions; 
Students respect teacher; 
Amount of productive tics; and 
Students obey teacher. 

Except for the second variable, assessments Indicated higher 
scores for more effective teachers. This sample of the variables 1 
which showed differences clearly Indicates aspects of teacher 
behavior that are related to a management function. Not all 
variables showed differences between the two groups. Assessments on 
variables listed below showed no differences: 

Attractiveness of room; 
Democratic leadership; 
Teacher socializes with students; 
Teacher showmanship; 
Emphasis on grades; and 
Teacher's command of subject. 

Of course, finding no difference between these two groups does 
not mean that the variables are necessarily unimportant. For 
example, none of the teachers were judged to have poor command of 
their subject, so that both groups* assessments In this area were 
high. The point Is simply that the teachers were not different on 
all variables, but there were reliable differences on variables 
related to a dimension that can be characterized as classroom manage- 
ment effectiveness. 

This result was not an isolated finding. A number of other 
process/product research studies had also found variables in the 
domain of classroom management to be related to student learning 
gams. Summaries of the literature identifying such variables are 
provided by Medley (1977) and Good (1979). 

Another reason for studying classroom management has to do with 
Its centra I ity to the role of a teacher. A major part of the task of 
teaching is to manage a classroom; that is, to prepare the setting, 
to organize activities, to arrange students in that setting, and to 
engage children in whatever activities are appropriate to master the 
curriculum objectives (see Doyle, 1979, for an insightful discussion 
of teacher and student roles in management), 

A third reason for studying classroom management is the absence 
of a unified conception of it in the teacher-preparation curriculum. 
Courses devoted primarily to classroom management are generally not 
included in the required teacher-education curriculum, and management 
tends to be considered diffusely throughout the program. It was 
hoped that more pragmatic research might build a firmer base for this 
dipect of teacher education. 
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Criteria for Effective Mana^ent 

Our researcli progran and numerous studies of classroom manage- 
ment have used several criteria for Judging whether a classroom Is 
effectively managed. The typical approach Is to define mana^ent In 
terms of observable student behavior rather than an a priori c<HKep> 
tion of what an effective manager does. Two types of student 
behaviors are frequently used. Is the degree of disruptive 
behavior exhibited by one or more students In a classroom. Disrup- 
tive beheivior, by definition. Interferes with the teacher or other 
students, and teachers take a very dim view of It. Related variables 
Include: deviant behavior, unsanctioned, off-task behavior, and 
aggressive behavior. A second type of student behavior frequently 
used as a criterion In management research Is the degree to which 
students are appropriately engaged in classroom activities. Engage- 
ment rate reflects the degree to which students are Involved In 
whatever activities are Identified as appropriate for the content or 
learning objectives In the curriculum. Related terms Include: 
attentive behavior, student Involvement, and on-task behavior. 
Studies that use both criteria simultaneously In classrooms have 
reported moderate correlations tetween the two types of variables, 
suggesting that although related, each variable contains some unique 
information about the setting. The use of these criteria for effec- 
tive management, while logically defensible by virtue of the 
teacher's role In maintaining an orderly and appropriate environment 
for learning, also has empirical support. These variables have been 
found to predict student achievement gains (For example, see reviews 
in Bloom, 1976; Jackson, 1968; and by Hoge and Luce, 1979). 



A Conception of Classroom Management Task 

Classroom management can be described as a series of activities 
directed at establishing a setting in which students engage in 
learning activities designated by the teacher and in which disruptive 
behdvlor is kept at a minimum. There are three major phases to the 
process of establishing and maintaining a well -managed classroom. 

Pre-active phase. This phase of classroom management occurs 
prior to the arrival of students and consists of preparing the physi- 
cal setting, planning beginning of year activities, and identifying 
expectations for student behavior and for work requirements. 

Beginning the year. The second phase in classroom management 
occurs when students arrive. During this phase the teacher communi- 
cates expectations to students, establishes norms for behavior and 
work, and establishes routines and procedures for conducting activi- 
ties. Depending upon the age and grade level of students, this phase 
may take anywhere from a few days to several weeks to complete. 

Remainder of year. In the third phase of classroom management, 
the emphasis is on maintaining norms for behavior and work. During 
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this stage the emp'iasis In manasement shifts from socialization of 
sttt<tents into the cUssroom^ setting to tesi^ihg atid cooductiog 
activities In ways that keep students actively engaged. Provisions 
for student success and adapting Instruction to meet Individual 
student needs (especially lower-achieving students) are critical in 
this stage. 

No Ifltpllcatlon Is Intended that the planning activities in phase 
one and the norm-setting activities in ph^se two do not occur at 
times other than at the beginning of the year. Certainly, new 
procedures can be introduced at other times, and changes In the 
physical setting or behavior norms can and do occur. However, our 
experience In observing maf\y classrooms at the beginning and 
throughout the year is that, in most cases, the major share of 
activities In th^se areas occurs as described above. 



Major Coreponents of the Pre-Active Phase 

There is a growing research literature dealing with teacher 
planning and decision making (cf. Shavelson and Stern, 1981). 
However, most of this literature Is descriptive rather than an 
attempt to Identify planning characteristics of teachers identified 
g Infective according to some criteria. Thus, although we regard 
the pre -active phase of management as important, its processes are 
revealed only sketchlly by research. Generally, teacher planning 
appears to focus around the iidentlficatloil of suitable classroom 
activities and be more influc^nced by the context (1.e., the nature of 
students, available material) and student motivation or Involvement 
than by learning outcomes. That Is, teachers do not plan instruction 
starting with ]earning objectives and proceeding systematically to 
examine methods for attaining those objectives. The research on 
teacher planning for the beginning of the year is much sparser than 
research on planning generally, and does not provide a basis for 
specific recommendations. Descriptive studies have indicated that 
much teacher activity during the week before school begins is 
directed at room preparation, reviewing and organizing files and 
materials, and identifying a schedule of activities. How teachers 
form expectations for student behavior, decide on what activities are 
appropriate for beginning of year, and match student work require- 
ments with entering-student capabilities are not researched in the 
context of beginning of year. One study did examine teacher activi- 
ties and plans for the first day of school, using 11 relatively 
inexperienced middle-school teachers (Worsham & Emmer, 1983). In 
this study teachers had primarily procedural and behavioral concerns 
(rules and procedures, administrative tasks) for the first day and 
pidced relatively little emphasis on academic or affective com- 
ponents. One interesting finding was that teachers with a more 
balanced affective and procedural fpcus had better success in terms 
of student engagement rates and disruption than teachers who had only 
d procedural focus on the first day. Affective concerns here refers 
to activities or plans to make the students feel welcome to the 



classroom or become acquainted with the teacher and each other. 



Given a sparse literature on effective planning for the begin- 
ning of the year, we must infer planning categories frwn observations 
of teachers at the beginning of the year* Based on these observa- 
tions, esf^cially of more effective classrw^ loana^rs, we can 
identify a number of areas in which planning should occur and which 
appear not to be the result of spontaneous teacher behavior. These 
dimensions are ^rived mainly from four studies of elementary and 
Junior high teachers (Emmer, Evertson & Anderson, 1980; Evertson & 
Efflmer, 1982; Efflmer, Sanford, Evertson, Clements & Hartin, 1981; 
Emmer, Sanford, Clements & Hartin, 1982). In these studies about 200 
teachers were observed both at the beginning of the year and 
throughout the year. A variety of observation procedures was used, 
including frequency counts of t^haviors, ratings, extensive narrative 
descriptions of classroom activities and behavior, and summary 
ratings and assessments made by observers and readers of the narra- 
tive accounts. The categories that appear to discriminate better and 
poorer managers that are relevant for the beginning of the year 
Include the following: 

Room preparation. The key features here are not attractiveness 
of the room or aspects of decor, but are related to Important manage- 
ment conslderatlofis, mainly those of monitoring and movement about 
the room, will be apparent from a later discussion of teacher 
management behaviors, the teacher's ability to monitor students is an 
Important component of management. Thus, the room needs to be 
organized In a way that permits the teacher to observe students 
easily. This means leaving a clear line of sight from small -group 
work areas to the rest of the class, avoiding "blind spots" where 
students can drop from sight, and arranging furniture so that the 
teacher can easily move about the room to monitor individual 
students. In addition, students need to be able to see instructional 
areas without undue turning around or movement, and commonly used 
mdteriaU and areas of the room must be easily accessible. 

Although these aspects of room preparation are helpful In 
credting a setting conducive to goo:! management, we do not wish to 
oweremphdsl their importance, nor to produce planning that focuses 
solely on this aspect of management. Many other aspects of preparing 
for the beginning of the year require attention. 

Identifying expectations for behavior. Teachers need a clear 
Idea of what benavlors are and are not appropriate In their class- 
rooms. Without such expectations, they are subject to the behavioral 
iijiosyncracies of particular students, they run the risk of being 
uiconsi stent, and they may allow behaviors to be established that are 
incompatible with productive use of classroom time. Identifying 
expectations for behavior is not simply a matter of listing a set of 
rules for students. Instead, it involves a process of conceptu- 
al win'j the r.ature of activities that will occur in the classroom and 
Identifying how students should behave in these activities in order 
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for a smoothly functioning class to occur. Major categories of 
activities Include: roots use, teacHer-led Instruction Including 
whole-class and sinall -group Instruction, seatwork, student work In 
groups (as In the laboratory or discussion activities), transitions, 
and behavior out of the classroom, Hore effective managers we have 
observed generally coismynlcete clearer expectations for student 
behavior In these areas. They frequently do so through establishing 
specific priMieOures governing student behavior, that Is, by Informing 
students ahead of time what kinds of behaviors are or are not appro- 
priate. To cite some examples, consider expectations for behavior 
during small -group reading Instruction In an elementary classroom. 
Some critical questions Include: 

May students call out, or must they raise their hands in 
the group? 

May students who are not In the group (1,e., who are 
involved in seatwork) talk, or must they remain silent? 

If students out of the group are permitted to talk, what 
kind of volume control will there be, e.g., whispering or 
"classroom voice"? 

What provisions will be maue for students who need help 
if the teacher is busy? 

Under what circumstances may students out of the group 
leave their seats? 

How are students in the group expected to behave? 

What should out-of-group students do if they complete 
their assignments before the end of the activity? 

What signal will be used to indicate that another group 
is being called to the reading-group area? 

If the teacher has formed expectations in these areas, then she 
or he will be in a better position to establish appropriate behavior 
to begin with, to communicate with students about what they are 
expected to do, and to prevent problems from occurring. In addition, 
if the teacher has thought through expectations in these areas, then 
the teacher is in a better position to monitor students and help them 
learn how to behave. Time and space do not permit a detailed 
analysis of each of these major areas. Such discussion can be found 
in references provided at tte end of the paper. From our interviews 
Mith teachers it is clear that these expectations for student 
behavior are not developed in a short period of time. In addition, 
some teachers, even those with substantial experience, never develop 
really efficient procedures in certain areas. Their overall manage- 
ment ski Ms are adequate to carry them through without major 
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problems, but they could benefit fr<»Q knowledge about other ways to 
. de^l with certain aspects of their classroom and Its activities. 

Managing student work. In addition to expectations for student 
behavior oescrlbed in the preceding section, more effective managers 
usually have clearer expectatlims for student work. The areas In 
wnich these expectations are manifest include the following: 

Coianunlcating assi granents and work requirements; 
Monitoring student progress and completion of assignments; 
Provisions for feedback for students. 

Within these three oMijor areas specific work requirements vary 
depending upon the age/grade level of the students and the subject 
matter telng taught. As In the case of procedures and expectations 
for behavior, specific asf^cts of managing student work can require 
careful and thoughtful planning. For example. In the area of com- 
municating assignments, some provision needs to be made for letting 
students know what the assignments are, such as by posting them In a 
specific place, developing procedures that will be applicable to a 
variety of assignments, such as appropriate heading, standards for 
work, and expectations for Incomplete or make-up assignments. In 
addition, some provision must be made for absent students, identi- 
fying what work they missed that must 1» made up, and for getting any 
extra help they need. 

Establishing appropriate expectations in these areas and 
developing classroom procedures for managing student work have 
several important management functions. The expectations reduce 
uncertainty for the students and provide them with cues for appro- 
priate bt.>hav1or. Once students have learned. the behaviors expected 
of them, teachers can initiate work activities quickly without 
needing to explain or spend large amounts of time on procedural 
details each time. -Finally, these procedures simplify the environ- 
ment for both teachers and students. The reduced complexity mea.is a 
greater change of smoothly running activities with minimal distrac- 
tions or Interruptions, 

Consequences . A fourth major category for planning Is deciding 
upon the consequences for students of their behavior and work In the 
classroom. We will deal with consequences more fully In the section 
under the third management phase. However, teachers who plan to 
utilize extensive reward or penalty systems or who teach in schools 
where school -wide systems are in effect, must plan their use of these 
systems carefully. Specifically, the particular rewards and penal- 
ties that will be used need to be associated with the specific 
behaviors for «»h1ch they will act as consequences. 




Beginning the School Year 

• 

It Is helpful to think of the beginning of the school year as 
having three major and conplementary goals. The first Is to 
acclimate students to their new setting while providing them with a 
sense of security and lessened aoKlety ai»ot^ their ability to perform 
and to tearn. This goat Is espectalty Important for younger children 
and for students with a history of difficulty In academic work. The 
second goal Is to establish an academic content focus so that 
students accept learning activities as the major purpose for being In 
school. The third goal Is to promote the acceptance of norms for 
appropriate behavior. In our studies of classroom matiagemint^ more 
effective classroom managers have used the first few days of class to 
state some genlral expectations* C(8nmonly In the context of a dis- 
cussion or mles for the classroom. In addition, these teachers tend 
to teach classroom procedures gradually over a period of days or 
weeks, giving careful explanations of what 1s-expected of students. 
Examples of areas In which these expectations are communicated were 
presented In preceding sections. These procedures are usually pre- 
sented In the context of the activity in whlch^they will be used, 
rather than taught as Isolated components, lll1t{^^younger students, 
teaching procedures can Involve rehearsal or demonyStratloo by the 
teacher. At a1) grades, teachers monitor students and give feedback 
as they begin using procedures. Feedback tends to be focused on 
whether the students are performing the desired behavior correctly. 
Not doing so tends to be dealt with supportlvely by giving further 
directions to the students or by otherwise helping them understand 
Mhat Is desired. At the elementary level, the communication of 
expectations and establishment of procedures and appropriate behavior 
is generally done during the first two weeks of the school year. At 
early grade levels teachers frequently Indicate that It takes three 
or four weeks before the class has settled Into the routines and 
structure. At the secondary level expectations about work require- 
ments and related matters tend to be more dominant and communicated 
duriny the first week of instruction. Expectations for behavior in 
major procedural areas are still communicated and are Important for 
the conduct of Instruction, but usually take less time—students at 
this level, after all, have participated in school experiences for 
many years. Teachers at the secondary level typically rely on clear 
explanations of expectations and prompt feedback to students If they 
engage in inappropriate behavior, rather than rehearsal or demon- 
stration of behavioral procedures. 

Activities at the beginning of the year are, for the most part, 
content-based but are usually characterized by low risk and high 
levels of student success. Activities tend to be whole-class focused 
{teacher-led instruction or seatwork), rather than small groups, 
individualized, or complex organizational patterns. Whole-class 
activities enable the teacher to monitor students readily and do not 
involve the use of complex procedures which might be difficult to 
teach, in addition to other procedures which must be learned at the 
beginning of the year. Moreover, activities that are relatively easy 
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reduce the likelihood of failure and aisc minimize demands on the 
teacher's time and attention. 

Teacher tehavlor during the beginning of school In more effec- 
tively-managed classes can be characterized by a ''take charge" 
leadership style. These teachers tend to be "front and center" and 
to maintain contact with students. They are the main source of 
Information about what students are expected to do and they stay 
actively Involved with the students, either by providing directions 
and instruction, or by monitoring. This does not mean that such 
teachers behave In a domineering fashlm or appear unmindful of 
students' concerns. In fact, Moskowltz and Hay^an (1976) found In 
their comparison of the first day of teachers rate as "best* by their 
students compared to first-year teachers, that the best teachers were 
more accepting of student feelings and ideas on the first day and 
sniled and joked more. In our studies, poor managers were more 
likely to give students difficult assignments in the first few days, 
work dt their desks without giving students adequate information or 
help, fail to monitor students, and otherwise lose contact with the 
class as a whole (e.g., by spending large amounts of time with indi- 
vidual students). 



Phase Three: Maintaining the Management Systems 

The remainder of the school year, after students have been 
initially socialized into the classroom setting, can be viewed as 
primdrily one of maintenance. This, of course, is an oversimplifica- 
tion because aspects of the management system can change and there- 
fore require introduction of new procedures and reorientation of 
students . 

The maintenance of a classroom management system is an active 
process. A number of characteristics in this process have been 
Identified. Most of these features of effective fflanac,ement are also 
Identifiable during the beglnning-of-the-year phase and help 
establish appropriate behavior to begin with. However, they come to 
the fore during the maintenance phase and are the primary means by 
which the classroom system functions smoothly. Without these charac- 
teristics, even the most thoughtfully composed set of expectations 
<jnd the most carefully planned classroom procedures for managing 
student behavior and work will not be sustained throughout the year. 
In other words, "well begun" is only holf-done. 

Monitoring. A major characteristic discriminating more and less 
ftfective classroom managers is their monitoring of student behavior, 
both with respect to following classroom rules and procedures as well 
<3s dCddemic performance. Careful monitoring enables the teacher to 
detect problems in early stages before they develop into major diffi- 
culties. Monitoring also gives students quicker access to assistance 
when they need it. This skill is an important part of the teacher 
^-jridble JCounin (lu7u) labeled "withitness," which was operation- 
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allied as the percentage of teacher "desists" which were correctly 
targeted and timely (I.e., dealt with the Inappropriate behavior 
before It escalated or spread to other students). This variable was 
strongly correlated with the degree of on«task student behavior and 
negatively correlated with amount of deviant behavior. 

Prompt handling of inappropriate behavior. A related charac- 
terlstic to monitorfng and another part of "withitness" is prompt 
handling of Inappropriate behavior. Compared to less effective 
managers, better managers tend to deal with inappropriate behavior 
rather than ignore it. This component is affected by the teacher's 
monitoring skills and also because better managers* preventive 
strategies tend to limit the amount of Inappropriate behavior in the 
first place. It simply is easier to deal with inappropriate behavior 
when It occurs occasionally than when It is occurring frequently. 
High rates of inappropriate behavior put the teacher in a dilemma: 
to deal with the individual behaviors will cause constant interrup- 
tions of whole-class or group activities; to Ignore the behaviors 
results in many students not attending to lessons and not under- 
standing the tasks they must do. This Is another reason for the 
Importance of establishing a well -managed setting to begin with; It 
is obviously much easier to maintain a setting in which students are, 
by and large, behaving appropriately than it is to redirect student 
behavior that exhibits high levels of disruption of non-Involvement. 

Procedures for dealing with inappropriate behavior used by 
better managers tend to be relatively simple and unobtrusive. Thus, 
it Is extremely rare to observe a teacher stopping an ongoing class- 
room activity to have a conference with an individual student. Like- 
wise, frequent use of penalties is rdtre}y seen. Instead, these 
teachers rely upon simple procedures, such as focusing class 
attention on the ongoing task, redirecting student behavior to appro- 
priate activities, citing procedures that students should follow, 
making eye contact, or simply issuing a mild desist statement, such 
dS mentioning the student's name or asking him or her to stop what- 
ever the Inappropriate behavior is. 

Reward and feedback systems. Another Important component of 
classroom management for maintaining student behavior Is a set of 
consequences, both rewards and penalties. This area is probably the 
most researched aspect of management, although much of the literature 
tends to be small-scale behavior modification studies outside regular 
classroom settings. Enough of this research has been conducted in 
TMijuIdr settings, however, to allow us some confidence in identifying 
rMaracteri sties that can be helpful In maintaining appropriate 
stufjent behavior. 

A commonly occurring co'^sequence Is that of teacher approval, 
recognition, or praise (see brophy, 1981, for a good review of this 
area]. Hecent research has suggested that the effects of teacher 
approval depend on the student's interpretation of It, and that It is 
proftaDly Tiust effective when directed at student accomplishment and 
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effort. If students Interpret teacher approval as attempting to 
control then, then it is not likely to have the desired effect, 
especially with older children and adolescents. In our observations 
of classrooms we have noted different levels of reward -and -penalty 
systems In terms of the ammint of effort which teachers are required 
to expend in establishing and utilizing these systems.. The least 
complex systems are those which rely mainly on teacher approval and 
the use of grades. Moderate systems Involve the use of rewards, such 
as privileges, recognition awards, such as honor students, badges, 
and certificates. Thtf most complex systems Involve the use of some 
Kind of token economy or chip system which Identify specific 
behaviors that are rewarded and in which students or the class 
receive rewards based upon their accumulation of tokens. In a 
similar manner, penalty systems can range from simple to complex. 
Simple systems utilize the witholding of privileges and teacher 
disapproval for inappropriate behavior and reductions in grades for 
poor work. More complex systems can utilize response cost 
strategies, removal of students from desired activities, as well as a 
tiered system of time out, contracts, and susf^nsions. We have 
observed effective managers using very simple systems as well as 
complex systems in both areas. Thus, a blanket endorsement of one or 
another type of reward or penalty system does not seem appropriate. 
It appears that a minimal system can be used with good effect, but 
that more complex systems may be helpful in dealing with special 
problems, such as a class with mati/ students who have poor motivation 
for academic work or who have experienced considerable prior failure 
or difficulty in the subject. What does appear to be important, 
whatever system is used, is that it be used consistently and that 
students understand what behaviors are rewarded or penalized. Incon- 
sistency, especially In the use of penalties, can quickly undermine 
complex systems and result in high rates of inappropriate behavior. 
As several researchers have noted (Sawin and Parke, 1979; Parke and 
Deur, 1972), inconsistent use of punishment can result in very high 
levels of aggressive behavior. 

Activity structures. Activities can be regarded as a basic unit 
of classroom life. Doyle {1979, p. 47) notes that "Teachers 
encounter classrooms as units of time to be filled with activities 
that can be justified educationally and as groups of students who 
vary widely in aptitude and propensities for such activities," 
Student and teacher behavior occurs in the context of classroom acti- 
vities (or in transitions between activities). Thus, the design and 
conduct of activities is a critical task for teachers and has great 
impact on the overall success of the classroom management system. 

Important aspects of whole-class and group instruction activi- 
ties include the degree of clarity of teacher directions and instruc- 
tion, the pacing of activities to maintain student involvement, and 
tne smoothness (see Kounin 1970) of dctivities, that is, the degree 
to which they are free from intrusions and interruptions. In seat- 
*tork activities, the match of task- demands to the students' 
abilities to perform the tasks is an important factor in maintaining 
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involvement, especially the degree to which materials and activities 
accommodate lower -achieving students* Another variable identified by 
Kounin as Important for maintaining Involvement In seatwork act1v1< 
ties Is the degree of variety and challenge In the tasks. Finally, 
the continuity of signals In the activity Itself (fCounIn & Doyle, 
1975; Kounin I Gump, 1974) Is Important for maintaining Involvement. 
Continuity refers to the itegree to which the -activity contains, or 
the teacher provides, prompts, or cues that l^lp students Identify 
next Heps. In addition, podr results occur when teachers spend 
large amounts of time with individual students (Scott & Bushel 1,, 
1974). No doubt this reflects both the difficulties In monitoring a 
whole class when tte teacher works with Individual students^ as well 
as problems In adapting Instruction for particular kinds of students 
In the class. Finally, transitions between activities or at the 
beginning and end of a period or day can also be a source of manage- 
ment problems. Arlln (1979) found that the rates of off -task 
behavior were higher during transitions than during other classroom 
activities. He also found that when teachers structured transitions 
(for example, gave students directions about what they were to do, or 
had d routine for the transition), the Inappropriate behavior was no 
higher than during regular classroom activities. 



Summa ry 

Classroom management is viewed as the result of three phases of 
activity. During a pre-active phase before students arrive, teachers 
form expectations for student behavior, plan rules and procedures, 
prepare the classroom setting, and Identify initial activities for 
students. A second phase begins when students arrive and continues 
for up to several weeks, depending upon the age/grade level of the 
students. During the beglnnlng-of -year phase, teacher expectations 
are communicated, students are socialized into the classroom setting, 
and procedures and routines for classroom activities are begun. 
Durinq the third phase, occurring throughout the year, the classroom 
system is maintained by careful teacher monitoring, prompt handling 
of problems, and carefully designed and conducted activities. 
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Because linguistic deficiencies and/or lack of awareness of social 
cues, some sMents may have much more difficulty convincing 
teachers that they know the material than do other students." 



■ Recent research has shown that students may interpret the same 
teacher ioehavm in different ways. Hence, those interested in teacher 
expectation effects have become more interested in student expecta- 
tions and in how students influence teachers." 
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RESEAKCH ON TEACHER EXPECTATIONS 



ThoBus L. Good 
Center for Research in Social Behavior 
University of Missouri -Columbia 



I believe that we have made progress in cUssroom research 
during the past decade in part because we have started to examine 
more sophisticated questions. In order to continue this progress we 
must accept some of the .limitations of research and especially the 
fact that research yields directions and concepts, not answers. 
Blind application of research findings needs to be discouraged, not 
only because the nature of any problem varies from class to class, 
but also because of our limited knowledge about the classro(»n 
processes and conditions tnat facilitate student achievement. 

There is much to be learned about the forces that Influence 
classroom thinking, behavior, and outcomes. For example, we have 
Httle Information about conditions that are associated with achieve- 
^ment in subject areas other than basic skills, and virtually no 
consistent, reliable data concerning how to stimulate student affec- 
tive growth. We need to acknowledge that describing and affecting 
classroom learning is an enormously complex task, and we should be 
suspicious of simple models of teaching that offer universal solu- 
tions to classroom problems. Thus, although I am very encouraged by 
the recent progress achieved by classroom researchers, I am equally 
impressed by the complexity of the classroom setting and by un- 
examined and unanswered questions that confront --.lassroom research 
and practice. 

Still, we know considerably more about classroom teaching than 
we did a decade ago. In 1973, information about the effects of class 
room conditions on student achievement was weak and contradictory. 
In the ensuing 10 years the literature on basic skill instruction, 
especially in reading and mathematics, has moved from a state of 
confusion to a point where several successful field experiments have 
been conducted. The"^ studies illustrate that teacher behavior can 
have significant, practical effects upon student achievement. 

Extant findings clearly indicate that teachers vary widely in 
(among othe'" things): (a) how they utilize time in the classroom. 



* ~Th"e'duthor gratefully acknowledges the time and resources made 
available at the Center for Research in Social Behavior, University 
of Missouri -Columbia. He is especially grateful to Patricia Shanks 
for typing the paper. 
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(b) N)«< they manage classroom activities, (c) hoM they select and 
design classroom learning tasks, (d) how actively they teach and 
coffimunlcate with students about classroom learning tasks, and (e) the 
expectations and academic standards that they hold for themselves, 
peers, their classes, and for Individual students. Not only do 
teachers vary across these dimensions, but research demonstrates that 
these aspects of classroom life are related to student achievement. 
Research also shows that student factors mediate between teaching and 
learning. A major goal of this paper Is to describe research 
findings In one of these areas. The Issue addressed here Is the 
relationship between teacher expectations and student performance. 



Teacher Expectations 

Teachers vary considerably In how they use time, manage class- 
rooms, mediate textbook and curriculum assignments, and In the extent 
to which they emphasize either meaning or drill -like activities. 
However, instructional variation can be found not only between class- 
rooms (e.g., how two teachers vary from one another In their class- 
room behavior), but also within classrooms (one teacher behaves In 
different ways toward subgroups of students In his/her class). For 
instance, some teachers who provide considerable feedback may evenly 
distribute their evaluative comments to students, but other teachers 
may provide feedback to only a few students in the class. Although 
some teachers fail to provide entire classes with appropriate content 
and stimulation, in many classrooms students perceived by teachers to 
be low achievers are the ones who receive Inadequate Instruction, 

Much of the research conducted on teacher expectations in the 
19/Os consisted of classroom observational studies aimed at determi- 
ning what teachers do in their interactions with high- and low- 
dcnleving students. ~lhe extent to which teachers differentiate in 
tneir behavior toward students has been found to represent an indivi- 
dual difference variable with some teachers varying their behavior 
more than others (Brophy & Uood, 1974; Good & Brophy, 1980), 
Explanatory variables which indicate when and why teachers are likely 
to behave differently toward high- and low -achieving students have not 
been frequently studied (for exceptions see Cooper, 1979; Cooper & 
Good, I9y3). It is not clear iKhether teachers who differentiate 
shdrply in their behavior toward highs and lows do so because of 
personality variables (defensi veness, rigidity), school or classroom 
'jrcjdnuational factors, characteristics that individual pupils and 
'jf-oups of students bring to the classroom or a combination of these 
rin^l otner factors. 

Although the causes of differential interaction are not 
'Jwfmttely established, it is clear tnat many teachers vary sharply 
n T.hew interaction pdtterns with high- and low-achieving students, 
riropny dnd Good (1974) estimated that one-third of the classroom 
-r'-i ntTS who have been observed ui related research have shown 
r^rn^ of nighly differentiated behavior toward high and low 



ERIC 



160 



achievers. Teachers differentiate their behavior toward students 
they perceive a high or Iom achievers In a variety of ways. (For a 
cofliprehenslve discussltm of these variables see Cooper & Good, 1983; 
Uood S 1978, In press). We will list here only a few of the 

ways teachers have been found to differ If their treatment of 
students: (a) calling on lows less often to answer classroom 
questions or to oialie public demons t rat Ions, (b) waiting less time for 
tows to answer questions, (c) praising lows less frequently than 
highs after successful public responses, (d) criticizing lows more 
frequently than highs for incorrect public responses, and (e) not 
staying with lows in failure situations (providing clues, asking 
follow-up questions). 

It is Important to examine the Implications of such teacher 
behaviors for low achievers. It seems that a good strategy for slow 
students who face such conditions would be not to volunteer or not to 
respond when called on because such an instructional system dis- 
courages students from taking risks. To the extent that students are 
motivated to reduce risks and ambiguity —and many argue that students 
are strongly motivated to do so—it seems that stu"aents would become 
more passive in order to reduce the risks of public failure. 



Explanations for Differential Teacher Behavior 

One basic cause of differential behavior Is that classrooms are 
very busy and complex environments and It is difficult for teachers 
to accurately assess the frequency and quality of their Interactions 
with indlvidu ' students. 

A secon( -lanation Involves the fact that much classroom 
behavior has ? Interpreted before it has meaning. Research 
(e.g., Andersc itt, in press) suggests that once a teacher 
develops an e <tion about a student (e.g., the student is not 
capable of lea» j), the teacher Interprets subsequent ambiguous 
classroom events in a way consistent with the original expectation. 
Good {19»Q) maintains that most classroom behavior is ambiguous and 
subject to multiple interpretations. 

A third reason why teachers differentiate more or less in their 
behavior toward high- and low-achieving students involves the issue 

c<*^sal Uy. Some teachers believe that they can and will influence 
student learning (for example, see Brophy & Evertson, 1976). Such 
teachers may interpret student failure as the need for more instruc- 
tion, more clarification, and eventually increased opportunity to 
iearn. Other teachers, because they assign blame rather than assume 
partial responsibility for student failure, may interpret failure as 
tne need to provide less challenge and fewer opportunities to learn. 
Teachers who do not have a strong sense that they can Influence 
stud<»nt learning are therefore more likely to overreact to student 
error and failure (perhaps by subsequently assigning work that is too 
Hjiyj than teachers who feel that they can Influence student learning 
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and that they are a partial cause of student failure when It does 
taice place* 



Another explanation fo^ differential teacher behavior Is student 
t»ehav1or. Students present themselves In different ways to teachers 
and these sel f -presentation styles may Influence teacher responses. 
Oee Spencer Hall (1981) hds noted that some students are able to time 
their ffllsbehavlor In such a way as to escape teacher attention, 
whereas oti^ students who mistehave just as often are reprimanded 
considerably more frequently because the timing of their misbehavior 
Is Inappropriate. Carrasco (1979) sugsests that students may demon- 
strate competence In a style that escapes teacher attention. 
According to Green and Smith (1983), the language %me students use 
makes It likely that teachers will underestimate their potential. 

Metz (1978) provides another Illustration of how students may 
influence teacher tehavlor. She reports that students In low track 
junior high classes like to do seatwork and dislike public Inter- 
action and classrwm lecture. In part, low achievers prefer seatwork 
(and encourage teachers to assign more seatwork) because It presents 
less risk to then. We previously noted that teachers who do not 
possess management skills are especially likely to be vulnerable to 
student influence, Finally. McDermott (1976) found that In one 
classroom low achievers received less reading practice because they 
were interrupted frequently by other students during reading Instruc- 
tion. The Interruptions were partly due to the fact that the lo^^ 
achievers' behavior during reading group allowed other students to 
interrupt them, ^nce, students appear to be an active part of the 
expectancy cycle. The behavior of some students encourages and 
reinforces teaching efforts; whereas other students* behavior dis- 
cuurdges teaching. 

Green and Smith (1983) report that teachers use linguistic 
performances as one basis for evaluation of student performance. 
Thus, students must know academic information as well as how (and 
when) to display academic knowledge. Being accurate was not enough; 
students needed to present information in appropriate form at the 
appropriate time. Students have to know both the form and the con- 
i^nt required. Thus, because of linguistic deficiencies and/or lack 
of awareness of social cues, some students may have much more diffi- 
culty convincing teachers that they know the material than do other 
students. 

tii^ have suggested several reasons why teachers may behave dif- 
ff^rpntly toward high- and low-achieving students: the complexity of 
viH classroom, the ambiguous nature of student performance, teachers' 
•^*^liefi about causal ity (their ability to cause or to influence 
stjdent performance), and students' behavior. Obviously, these are 
'l/namic influences and they often occur in combination. For example, 
',onfrey and Good (m progress) note that In one class students were 
;jla<-ed m either a high or low mathematics group on the basis of 
'.nftr teacher's Interpretation of the students' performances during 
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the first Meeks of mathematics class. The assignment of students to 
the high group was based in part upon the speed with which they were 
perforiBing matl^fnatics tasks. 

Ironically, a week of observation indicated that students in the 
low group often watched what the teacher was doing in the high group 
and in Interview sessions they indicated that they observed the highs 
because they wanted to get a step ahead and learn what the high group 
was learning. Unfortunately, because the teacher was interested in 
speed of performance and because lows spent time watchin<; the other 
group rather than doing their own seatwork, their incomplete seatwork 
assignments reinforced the teacher's original expectations and sup- 
ported the belief that the assignments to high and low groups were 
correct. Students' Interpretations of their classroom roles and 
their behavior influenced and maintained teacher expectations and 
behaviors. 



Student Passivity: Role Confusion 

Recent research suggests that teachers vary widely in how they 
react to student problems and this variation may make it difficult 
for students to understand what Is expected of them. As noted above» 
studies show that some teachers criticize low achievers more fre- 
quently than highs per incorrect response and praise lows less per 
correct answer than highs. In contrast, other teachers praise 
marginal or Incorrect responses given by low achievers. These 
findings reflect two different types of teachers. Teachers who 
criticize lows for incorrect responses seem to be basically 
Intolerant of these pupils. Teachers who reward marginal, even wrong 
answers, are excessively sympathetic and unnecessarily protective of 
lows. Both types of teacher behavior illustrate to students that 
effort and classroom performance are not related (Good & Brophy, 
1977). Over time, such differences among teachers in the way they 
prnse low achievers may reduce low students' efforts and contribute 
to d passive learning style. 

Utner teacher behaviors may also encourage student passivity. 
Low Students who are called on frequently one year (the teacher 
b*?heyes that they need to be active if they are to learn) but are 
S' idom called on the following year (the teacher doesn't want to 
eiiDdrrass them) may find it confusing to adjust to different role 
definitions. Ironically, these students, who have the least adaptive 
c-ipdcity, may be asked to make the most accommodation as tftey move 
from ddssroom to classroom. The greater variation In how different 
t»'di.rtters interact with lows (In contrast to the more similar patterns 

behavior that high students receive from different teachers) may 
D*.' 'jue to lack of agreement among teachers about how to respond to 
stufl«»nts who do not learn readily, 

r vei"' within a given year low achievers must often adjust to more 
/dnci /><pectations. This may be true in part because many lows have 
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several teachers (In addUlon to the regular teacher they may have a 
remedial math, reading, or speech teacher). Ironically, these 
students may receive less and/or different Instruction because of 
attempts to provide them «^1th extra assistance. Hill and Kimbrough 
(1981) studied pull-out Instruction In schools that operated four or 
more categorlal (special need) programs. They found that pull-out 
programs posed problems for students who received special assistance 
as well as for regular teachers because, due to scheduling problems, 
special programs were replacing, not supplementing, the core curri- 
culum for many students. 

Even Mhen students did receive both regular and supplemental 
instruction, they were still not well served. Hill and Kimbrough 
found that In several cases Incompatible teaching methods and 
materials were used In special and regular classrooms. Hence, many 
Chi Idren >ecame confused by conflicting approaches taken by special 
and regular teachers and conceptual learning was especially difficult 
for these students. 



Grouping and Expectation Effects 

Much of the recent research on. teacher expectations examines 
teacher behavior toward individual students. However, there Is 
growing evidence that students may also be affected by grouping, 
which often results in differential instruction. Confrey and Good 
(in progress) observed instruction in seventh-grade English and 
mathematics classes and interviewed some students in high and low 
groups in each class. They found that content presentation to low- 
achieving students was often characterized by fragmentation of 
mdterial. repetition, little presentation of theory, and few integra- 
ting concepts. Students in low groups in classes grouped by ability 
spent much of their time on repetitive drill activities which were 
inadequately presented and discussed and not^uf ficlently related to 
relevant Integrating concepts. Students were unlikely to receive the 
intended benefit from these activities even if they did t<iem 
correctly. 

tder (1981) found that students in one first-grade class who 
were likely to have difficulty learning to read were assigned to 
groups whose social context was not conducive to learning. In part, 
this was because assignments to first-grade reading groups were based 
upon kindergarten teachers* recommendati^s and a major criterion of 
placement was the maturity of the students as well as their perceived 
d&ility. Eder observed reading group benavior throughout the year 
and found that the teacher discouraged interruptions of students' 
arrii reading turns within the high group but not in the low group. 
According to Eder, the teacher may have been concerned with main- 
tdimng the interest of the low group during other students* reading 
turns (in tjenera] , their reading turns tended to be longer and 'filled 
wt':n nore pauses). The teacher may also have thought that lows had 
U'S', intrinsic interest in the material; therefore, she was more 
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Milling to encourage oiost forms of pdrtUlpation or responses from 
low itudents but demandecl more appropriate bc'.avior and responses from 
hiijhs. 

Because ttie most Immature, Inattentive students (as Indicated by 
the kindergarten teachers) were assigned to low groups* it was almost 
certain that these groups would have more managerial problems (e.g., 
distractions) than others, especially early in the year. Indeed, 
because the teacher was often distracted from a student reader in the 
low iiroup who was responding (because of the need to manage other 
students In the group, students often provided the correct word for 
the reader. Readers were not allowed time to ascertain words on 
their own, even though less than a third of the students interviewed 
reported that they liked to be helped and most thought this help 
interfered with their learning, Eder's work Indicates that low 
students had less time than highs to correct their mistakes before 
other students and/or the teacher intervened. 

Eder also found that students in the low groups spent 40% of 
their listening time not attending to the lesson (vs. 22% in the 
high groups). Low students frequently read out of turn, adding to 
the general confusion. Eder reports twice as many teacher 
•'manager lal acts" In the low groups as in the high groups (157 vs. 
bi), and found that turn interruption Increased over the course of 
the year. Due to management problems, frequent Interruptions, and 
less serious teaching, low students may inadvirten'tly have been 
encouraged to respond to social and procedural aspects of the reading 
;roup rather than academic tasks. 

It 15 difficult to conceptualize and describe what students 
!f»drn in school, especially from the examination of practice in one 
c I dssroom. However, it seems plausible that one of the effects of 
tjeing In high and low reading groups in the classroom studied by Eder 
tndt students learned different norms for attention. Students in 
t,n»' luK redding groups were encouraged to be inattentive; whereas, 
sVi'i«^nts in the high group learned to attend to instruction. 

In<ippropndtely low performance expectations are often asso- 
I it?'(i with guud tedcher intentions, but such expectations still have 
ndr;'iful effects. As d case in point, Bob Germain (personal communi - 
'-inon) hds found instances of too much structure ond direction. He 
^ound tfiat textbooics were giving cues to poor readers about where 
inMy .ould find the answers to questions that appeared at the end of 
'n,' h^pter, Some low -achieving students simply read a particuMr 
,.i ,f- nn^Tt' tney could find the answer rather than attempting to read 
J I ! th- indtt'Tidls. The cues embedded in the text materials were 
>Ui'.)i y pruvuled to help slow readers (in order not to overwhelm 
^'>^'-'i, Hi.'w^^^er, the practical effect was probably to encourage less 
r>' • J ' f..^ .jn J ; .^<-,'j tn 1 nk i ncj. 
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Teaching DUenwa 

Clearly, teachers can expect coo much or too little In their 
lostructional interactions with students. This dilemma also has to 
be addressed by curriculum specialists who write textbooks and by 
policymakers. There are many instances in which teachers need to 
assign different types of material to high and low achievers. 
Teachers can make instructional mistakes by treating students too 
much alike, as mcU as too differently. 

As I have pointed out elsewhere (Good, 1983], some teachers 
spend Inadequate time with low achievers, but other teachers appear 
to find appropriate time for such students. Hence, rules such as 
"call on ^ows" more often will do as much harm as good {i.e., since 
some teachers are a)rQa6>f doing these behaviors appropriately an 
increase in their behavior would have dysfunctional effects). Vne 
variables that affect teaching are numerous and complex. iO^owledge 
related to teacher expectation effects is therefore best imparted to 
teachers along with judgmental and decision •making skills about 
appropriate policy (not the provision of a few simple behaviors to 
use or avoid). For examples of work that illustrate and encourage 
teachers' use of decision -making skills generally, see Amarel (1981), 
and in the area of teacher expectations specifically, see Good and 
Brophy (1978, in press). 



Student Influence 

Although there is conclusive evidence that teachers signifi- 
cantly affect student learning, student motivation and effort are 
also important aspects of classroom performance. Student behavior 
-influences teachers' perceptions of students and In some cases 
affects the quality of instruction students receive. More directly, 
student perceptions o^" teacher behavior and student motivation are 
likely to influence how much effort students expend in the classroom 
(e.y., when classroom tasks are ambiguous and/or complex do students 
perceive them as a challenge and think and work or do they perceive 
such tasks as a threat and negotiate with teachers?). 

There is increasing evidence that students' perceptions and 
Sfji f -perceptions are important sources of information about classroom 
learning. One wonders how students perceive standards and how their 
perceptions influence performance. Too little research has attempted 
to answer such questions and we need to more systematically study how 
stu^lnnts perceive and respond to academic demands. How students 
r»-spond to these expectations should be an important research agenda 
in thp 19BUS. 
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student Perceptions of Schooling 



In d thorough review and integration of research on student 
perceptions of schooling, Weinstein (1983) examines studies of 
students' perceptions of teachers, other school personnel, peers, 
causes of behavior, the classroom, and the school. 



Perceptions of teachers. Concerning perceptions of teacher 
behavior, classrooms vary In the extent of differential treatment r 
perceived by students. There is evidence that students are highly 
sensitive to variations in teacher treatment (interactfion patterns 
and nonverbal messages) within classrooms. Through varied treatment, 
students infer teacher expectations for academic performance. More- 
over, differential relationships hold between teacher expectations, 
student expectations, and student achievement in classrooms where 
greater differential treatment is perceived than in other classrooms 
(e.g.. Brattesani, Weinstein, Middlestadt & Marshall, 1981; Weinstein 
& Middlestadt, 1979; Weinstein, Marshall, 8rattesan1 & Middlestadt, 
In press). That is, in classrooms where students were aware of 
teachers' differential treatment of high and low achievers, students' 
own expectations for themselves more closely matched the teachers' 
expectations, and the teachers' expectations for their students more 
clearly predicted student performance. 

Studies of students' perceptions of teacher instructional 
behavior (e.g., Peterson & Swing, 1982; Winne & Marx. 1980, 1982) 
suggest that student perceptions and cognitions during instruction 
can mediate the effects of instruction on student achievement. 
Evidence Indicates that students often may not perceive what teachers 
intend. Also, some students who appear to observers to be attending 
to lecture or class discussion reported in interviews later that they 
were actually thinking about other things, such as how they would 
perform In relation to other students. 

In some classrooms, students may perceive more differential 
teacher behavior towards highs and lows than is indicated by beha- 
vioral records made by classroom observers (Cooper & Good, 1983). It 
I-* not clear whether students report greater differences in teacher 
behavior because they have more cues and are more sensitive to 
teaching acts than observers or because cStudents "overreact" to 
certain cues. Some students are likely reliable observers of class- 
room events and others are probably not perceptive. Still, there is 
evidence that students can provide valuable insight about teaching 
(Cooper & Good, 1983; Weinstein, 1983). Just as teachers may act 
iipon their beliefs and perceptions (e.g., they believe an average 
'.tudent IS below average), students also react according to their 
perceptions of teachers' behaviors and intentions (Weinstein, in 
press ), 

Perceptions of ability. Developmental literature suggests that 
/Quny children perceive ability or intelligence as a changeable 
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entity which can be improved with effort* They also seem to rely on 
absolute and Individual standards rather than norms to assess 
ability. Blumenfeld and colleagues (1982) argue that young 
children's self -perceptions are thus biased In a positive direction. 

However, there Is much evidence that as students get older, 
classroom conditions (feec acis patterns, reward .structures) which 
increase the differences be^^een high and low achievers affect 
students* perceptions of ability, and their perceptions of their 
ability more closely match their teachers' perceptions. Students 
also evaluate their own abilities by comparing themselves with peers 
during the dally performance of taSks In classrooms. The evaluative 
cues available to students, however, differ according to the struc- 
ture (e.g., whole-class, group, or individual ; lecture,, seatwork) and 
climate (e.g., extrinsic vs. intrinsic reward structure") of the 
classroom and the school. A climate with high and flexible expecta- 
tions, varied tasks, and opportunities for evaluation, a focus on task 
mastery, and a belief in the changeability of intelligence can pro- 
vide a context in which students can evaluate themselves on several 
dimensions and feel positive about their potential for future 
success. 

Achievement behavior has t»en the most .frequently studied pro- 
cess in relation to students' perceptions of the- causes of behavior , 
particularly in an attribution framework. Applications ot attrlbu- 
tion theory to classrooms will have to consider how success and 
failure judgments are made by students. Recent work suggests that 
children's definitions of success vary across individual pupils, 
tasks, and situations (Frieze, Francis & Harrusa, 1S82). One study 
{Frieze & Snyder, 19^) of the attributional patterns of elementary 
students for success and failure in four situations showed that the 
dchlevement situation elicited different causal mechanisms than other 
situations. Effort was most important for school testing situations, 
while ability was seen as critical to finishing an art project or 
winniny m football. 



Percept 1on!> of Learning Act i vities 

students' perceptions of their learning activities vary widely, 
kecent literature suggests many young children and some>^older 
students are deficient in metacogni ti ve skills, particularly in four 
dreds: (a) predicting the difficulty of a task, (b) assessing the 
ncoinprehens ibi 1 ity or incompleteness of task directions, (c) plan- 
ntnj rfhedd and using available time wisely, and (d) monitoring their 
pfijqr^-ss dnd evdludttng their own performance. Many students many 
tntTeforf need some assistance in developing these skills. 
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Conclusion 



Initially, most c1assro<Hn research focused upon teacher beliefs 
and teacher behavior, and this same trend was evidenced In the area 
of teacher expectations. Indeed, the focus cm teacher expectations 
has yielded a rich way of looking at and Improving upon classroom 
behavior (Good & Brophy, 1978, In press). Hpwever, recent research 
has shown that students m«y Interpret the same teacher behavior In 
different ways. Hence, those Interested In teacher expectation 
effects have become more Interested In student expectations and In 
how students Influence teachers. As research becomes more complex 
and comprehensive and as research asks more sophisticated questions, 
it may become possible to Increase our understanding of classroom 
communication, ftowever. at present it Is clear that extant research 
has already yielded important Information and concepts that can be 
used to Improve practice. 
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■ My Claim is simple: anything that slights or Interferes with the effectiye- 
ness of moment-to-moment teaching and learning will subvert the aim 
to improve education." 

"When there are alternative perceptbns about how to respond to 
instructional cues, it is likely that some students won 't engage cognitive 
operations that teachers or autfK)rs of text interKl." 

"In general, teachers can help motivate students by muring that stu- 
dents make appropriate attributkxis for successes and failures. Do not 
butter them up ' by telling students they can do anything if only they 7/ try 
hard enough. Do tell them honestly why they,sacceeded or failed. And, 
whenever appropriate, focus studenfT'atfiwutjons for their failures on 
sources that are under their control." 

While it seems so obvious as to approach the trivial that students need 
to know what the task really is, how many 10th grade students really 
comprehend tasks like these: prove a theorem in geometry; analyze a 
hypothesis in science: interpret the meaning in a poem: program a sort- 
ing procedure for your computer: or characterize a policy of a gfovern- 
rment^ Students need to know what the task is and what they already 
'•riQw about it before tackling the task itself" 
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STL PS rUUARD PH(M)TIN{i COGNITIVE ACHIEVEMENTS 



Philip H. Winne 
Instructional Psychology Research Group 
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Burnaby, British Columbia, Canada 



The National Commission on Excellence In Education has Issued 
nothing less than a stark challenge to America. In Its report, A 
Nation at ^^sk: The Imperative for Educational Reform , the commission 
asserts uocondUlonally th^t if America does not remedy flaws and 
overcome difficulties In Us educational system, then the country's 
leading place in: the world may be forfeit. From my vantage point as 
an instructional psychologist, all_ the recommendations made In the 
report are welcome. But these proposals are, for the most part, 
global. They need to be analyzed further so they can be put into 
action. And, the report failed to consider one of the most obvious 
and most significant aspects of our educational system, namely, 
teacning. In this paper, I propose several remedies for this short- 
coming. My focus is topics that bear directly on what happens when 
teachers try to teach and when students try to learn from teaching. 

I hoiJ that instruction is the fulcrum on which the lever of 
education rests. There is no doubt that changes need to be made to 
the educational system --changes such as improving the quality of 
textbooks, or increasing the time allocated to learning and homework, 
or selecting better teachers. What teachers and students do in 
classrooms, however, determines whether other changes to the educa- 
tional system will have any effect at all. If instruction is flawed 
or inadequate, no other improvement to education will have fair 
chance to work. In taking this stance, I do not insinuate that non- 
insiructional aspects of education can remain as they are. My claim 
r. simple: anything that slights or interferes with the effective- 
less ut moment -to -moment teaching and learning will subvert the aim 
to improve education. 

me introduce some central ideas about instruction in the 
form of an analogy that should have direct relevance to each of you. 
I presume you are here to learn about how to promote cognitive 
dchievements, and that you expect me to teach you about steps to take 
10 approaching this goal. There is little doubt that, as a group, 
/ou enter this lesson with different interests, varying amounts and 
-^/pHS of Knowledge about the topics I'll address, and all sorts of 
other differences that may affect how much and how well you learn 
trgm my tdU. for instance, some of you undoubtedly should have gone 
to bed earlier chan you did to be in top form for today's sessions, 
'Jtners of you, in your zeal to arrive promptly at this first session, 
no«* may be distracted by your stomach's complaints about skipping 
brfM<fci'jt or wolfing something of less than home-cooked quality. 
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The kinds of differences I've just described clearly Influence 
now well this lesson will work. They are differences over whlcft I 
have no control. That they affect your achieveoeftt only reinforces 
my point that there must be taore teeth in responses to education's 
woes than merely a "quick fix" that I might attempt in the next hour 
of teaching. In role as teacher, however* I can influence to soine 
extent how you think. If it takes thinking on your part to learn, 
and I assert without proof that it does, then my teaching effective- 
ness varies in direct proportion to the extent that I can influence 
your thinking. The question that confronts me, as your teacher for 
the next hour, is how can I shape what you think about and how you 
think about it. 

Let me foreshadow the rest of this presentation. To address 
questions of shaping what students think and how they think about it, 
I'm going to present three models. These models synthesize contem- 
porary research on teaciiing and instructional psychology. Then, I'm 
9o1ng to use these models to suggest steps to take to promote cogni- 
tive achievements, as promised in my title. I'll wrap up my talk by 
offering a few suggestions about how these steps can be taken. 



Models for Describing Instruction 

I doubt anyone would claim that teaching and that learning from 
teaching are simple pursuits. To get a handle on complicated <sctivi- 
ties, however. It's often useful to consider simple versions of 
reality. Models are one form for such simplifications. Obviously, 
one model we should consider ought to describe what the teacher does 
while teaching. This model portrays Instruction from the teacher's 
persptfcti ve. While teachers are teaching, students are doing some- 
tmng, too. Thus, we need a second model of what students do to 
learn from teaching. It Should describe things from their point of 
view. These two models aren't sufficient however. We need yet a 
third model to describe how these first two fit together In the 
(.ur\tfnt of Other features of Instruction such as a curriculum and a 
socidl system that operates in the classroom. So, to describe 
in-jtruction representatively, I will present three models, not merely 
';n». or two. Ihis is ds It should be--instruction is not simple. Too 
■jrpdt an oversimplification jf the complex reality of Instruction is 
one yf the reasons I believe we have not advanced as much as we would 
Mk^ in promoting cognitive achievements. I will speak more about 
SI ^lip' 1 f ications versus oversi mpl ications later. Now, I want to lay 
t)ir'' ny d'^sumpt i ons about instruction. Then I'll describe the three 
•'.j'ii'U need tu address questions about what to teach it in 

^■-)'"Otin'j cognitive achievements. 



A-,i'>f'ipt. !Of)s bridyf the inevitable yap between an infinity of 
".• n 1 1 I : les in tn^ory and 3 limited seu of particulars actually 
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dealt with In practice. They provide boundaries, setting off things 
that are considered from others that are ignored. I make three 
assumptions. 

First, teachers and students are inherently cognitively active. 
Moreover, except for rare random perturbations in thought and geneti- 
cally established reflexes, these cognitive activities are structured 
In patterns. 

Second. I assume that learners pursue learning strategically and 
purposefully. This means that the cognitive activities that underlie 
learning are directed toward goals. This assumption doesn't contra- 
dict the fact that learners sMietimes can't articulate what they have 
achieved or how they went about learning. What people learn some- 
times can seem to themselves and often seems to observers to have 
been ]Bdrneii "unconsciously." Nonetheless, I assume that even in 
these cases, the cognitive activities that produced learning were 
strategic and purposeful* 

Third, I assume that instruction is Intentional. A teacher, or 
d surrogate for a teacher like a text or film, purposefully tries to 
determine what ci student learns. This assumption doesn't deny the 
fact that students learn things unintended by the teacher. These 
learnings, however, do not result from instruction. Rather, they are 
the products of learners' Inherent cognitive activity. 

The first two assumptions characterize teachers and students as 
inteHigent people who seek to achieve goals through action. The 
tnird assumption sets the stage for teaching to be ineffective. More 
specifically, whenever teachers' intentions go unfulfilled, instruc- 
tion may not succeed. Arranging features of instruction to head off 
failure is a key to effective teaching. In order to make such 
arrdnyements, however, we need a directory of the features that 
comprise Instruction. This directory is the model I will outline 
first. It provides a frdmework for fitting together the other two 
models I wiH present later to describe teaching and learning from 
teacning. 



^d cets of Instruction 

The first model is based on research from the field of verbal 
learning. It describes instruction in terms of six facets: content, 
eviluation data, delivery of task cues, students* cognitive opera- 
cton"* dpphed to acquire content and to retrieve content, and setting 
^I't'jrs. First, I will describe each facet briefly. Then, I will 
Jyinun-itrdte their interactive character. 

Co ntent . The Information and motivations that teachers intend 
-i.tudpnts to learn are content. There are three broad categories of 
;.'irit^nr,. The first category is knowledge, knowledge can be sub- 
-5t/ifjHd further into two types. Declarative Knowledge defines and 
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describes huflidn experience. A definition of peninsula, an explana- 
tion for why a test was too hard, and an understanding of the 
periodic table of the eTefnents are examples of declarative knowledge. 
The second type of knowledge Is procedural knowledge. Procedural 
knowledge Is a structure for action, for carrying out thinking or 
overt behavior. A heuristic for solving i^yslcs problems, a techni- 
que for coaxing a friend to help with homework, and a oeans for 
Identifying essential Information' In a textbook chapter Illustrate 
procedural knowledge. 

The second category of content pertains to feelings and motiva- 
tions. This type of content explains students choices afflong actions, 
and their vigor and persistence In pursuing those choices. Feelings 
of satisfactiwi and test anxiety illustrate this category of content. 
These are emotional reactions to past events and to events In the 
future. 

The third category of content Is called schemata. Schemata are 
complex, goa*! -oriented integrations of declarative and procedural 
knowledge and feelings. They are guides for taking action that 
delicately balance knowledge and motivation. Because their character 
is not found solely in the mere sum of their parts, schemata are 
accorded a separate category of. content. As an example, when 
studying for an exam, a student's schema Includes procedures for 
reviewing known material and Its organization, and for checking how 
clear '^he material is. The schema also balances feelings about 
whether it is better to postpone telephoning a friend. As well, it 
includes hope for a good mark. It also contains criteria for 
deciding when fatigue makes further studying unprofitable, and more. 

Evaluation data. This facet of instruction reflects the fact 
thdt students often receive feedback about their attempts to learn. 
Evaluation data always achieves meaning by a comparison either to an 
absolute standard or to a norm. The standard or the norm may be 
chosen by the student, as when a student sets a personal goal to 
dcnieve a mark of bbIL Or, the standard or norm may be imposed by 
the teacher. An example here is the case where teachers do or don't 
.iward partial credit. For students, the most obvious although not 
Ht'ce^Sdrily the most potent kinds of evaluation data are teachers' 
r»?dctions in class and the scores received on tests and assignments. 

Delivery of taste cues, hihen students try to acquire or retrieve 
-.ontent they have a task to accomplish. In setting these tafks, 
•""-ii hHfi try to guide students' thinking by providing cues about how 
sVidnnts njKjht cognitively work on content. Two examples of cues 
i-Mj, Hi^r^ often use to shape students' cognitions are telling students 
f. } ; ofK for ^imildrities between two concepts and starring particular 

of <nuwlpdy*» written on the chalkboard. Since cues like these 
ir.' intended to help students acquire new knowledge, they can be 
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Correspondingly, there also are cues teachers deliver to shtoe 
students* cognitions dtrected to retrieving infonnatlon, wi example 
of a retrieval cue would be a teacher*s admonition to "think hard" 
before answering a question. Presumably, this signals to students 
tn#t t^py shouldn't necessarily be satisfied with a first or 
seemingly obvious answer. Instead, students should seairch their 
memories deeply before answering^ 

Acquisition cues and retrieval cues also appear In textbooks. 
Mjrgin headings are Intended to steer students toward acquiring a 
particular structure of content. Italics Invite students to spend 
extra effort to acquire particular concepts. And questions Inserted 
in text ask students to practice retrieving content in particular 
ways. Thus, the delivery facet concerns attempts by a teacher, text, 
uf fjim to engage students In particular types of thinking about 
content to learn It and to retrieve It. 

Acquisition operations. Students don't learn content by 
osmosis. Students acquire content by cognltively working with it and 
on \i. To do this, they almost always activate related information 
thdt was learned prevlous'jy. Sometimes, they may translate words 
t«to mental images or vice versa. Also, they may rehearse new con- 
tent, create categories for bits of content, an<l monitor the products 
tn<tt result from these cognitive operations (Winne, 1984). These 
fiimis of cognitive operations make up another facet of instruction, 
tne tdcet concerned with thinking to learn content. 

Hetrieval operations. To find out what students have acquired, 
tne taacner or the students themselves create occasions for students 
If; retrieve content that was supposed to have been acquired* To do 
tni 5 mental work, students engage retrieval operations. These are 
ine cof^plement of acquisition operations. Retrieval operations are 
i-^-' "Atdns by which students bring content out of their cognitive 
sto^HQuse to accomplish tasks like supporting che learning of new 
r^-* j^^^^j mfofination answering test items. Mentally asking what Is 
. iuilar to d term in a ^{uestion, or categorizing information and then 

.ircj^^nq for otner content in this category are examples of 
rr^^. r : ^ ! Qperat i ons. 

'> f^f.t^n(^ variables^ Instruction always tdkes place in a social 
^rt^ rT^fgr-^l milieu. In classrooms, a large part of this milieu is 
r.^.ctjred by ^ He teacher. This is done through rules for classroom 
jfwj.jf.MTient , a system yovernlny rewards for students* scholastic and 
,;^*fvon.^i dcni r^vements, and routines for frequent activities lUe 

tf»sts, boardwork, or science labs. Students, too, shape this 
.f'M hy cn(josinc) fritends and models, by declaring their values, and 
v/^'?^. n/ rjir^ir physical health. Thus, general but usually flexible 
.^n'ji^.ions cire estibiisned ^itnin which instruction takes place. 
^ift'O-- '.on^itions are setting factors, 

.^^'Mn^sj^, fhese six facets maKe up a directory for describiny 
"'.Vi.Vfo^, The directory can be titled by an acronymn that uses 
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tne first letter of eacK facet: CEDARS, My brief descriptions of 
these facets barely hint at the true nature of instruction because I 
described each facet independently. CoiBmon sense and reams of 
research stress the fact that the facets interact. I can describe 
these interactions best by focusing microscopically on an example of 
one instructional act. At the same time» I'll develop the other tw) 
models needed to describe teaching and learning from teaching, 
respectively. 



Models of Teaching ano of Learning from Teaching 

An example. Suppose Mr. Jones just asked his class, "Hoit can we 
solve for X in a quadratic equation?" Jim replies, "By graphing." 
Mary chimes in, "By using the forwula," Then Mr, Jones responds 
enthusiastically, "Right, Jim] And Mary, what's the formula?" Why 
did Mr. Jones do this? 

Mr. Jones' praise of Jim's answer is both evaluation data and a 
cue he delivered to stimulate other students' cognitive processing. 
Tne eva1u'?t1on datum marks Jim's answer as correct. But this mark 
also must involve other students in thinking about content if they 
dre to learn that graphing is one method for solving quadratic 
equations. How should students think upon delivery of this acquisi- 
tion cue? 

Similarly, Mr. Jones' prompt for Mary to provide the formula 
dilso spans the delivery and evaluation facets. As an evaluation 
datum, Mr. Jone". Intends that his prompting question signals to Mary, 
(jnd to the other students, that Mary's answer is not up to a 
stdncjard. Mary didn't give a complete answer--she left out the 
formula. As well, the teacher's prompt Is a cue for students to 
'•espond cognltlvely to this Instructional interchange made up of a 
question, Mary's answer, and the prompting question. Can you guess 
f.Mf coynitions Mr. Jones is cuing? Can the students? I will 
describe two models that frame answers to these kinds of questions, 
but first, let's return to the CEDARS model momentarily. 

Who determines what? In terms of the CEDARS model , the teacher 
artj students exercise varying degrees of control over each of the 
facets. The content facet and the delivery facet are mostly con- 
trolled by the teacher. For example, if the teacher chooses not to 
present graphing as a method for solving quadratics, this content 
*toi}"i be part of instruction unless a knowledgeable student like Jim 
Jivulfjes it in class. Similarly, in most classrooms, the teacher 
i'«termines most of the cues delivered during teaching thtt are 
si'jnals to students about thinking. However, students also deliver 
cues that can guide cognition. Remarks like, "That formula seems 
rf?ally Important to remember" can function as acquisition cues. As 
-eil, teachers are almost solely In control of externally provided 
^vdiud'' on data that refer to declarative and procedural knowledge, 
')n tne other hand, students control most of what works as evaluation 



172 

ISO 



data for motivations. Teachers and students share control of 
evaluation data for schema. 

Features of tte setting facet are very much jointly determined 
by ti^e teacher and tl» students* Although the pace of teaching 
starts wc be teacher determined, stwtents almost always Influence 
pace by looking puzzled, asking questions, or nodding In agreement as 
the teacher talks. While the teacher can define rules for handing 
dut gradeSp students may treat these rules as a competitive system or 
an ladivldual one* As a last example, the climate of a class-«1ts 
openness, supporti veness, and so on—Is clearly Influenced by all the 
participants. 

The remaining two facets, the complementary cognitive operations 
that students engage to acquire content and to retrieve content, are 
mo:^t)y under each student's control* A student decides whether to 
pay attention or to rehearse a formula. How students think when 
acquiring and retrieving content Is central In determining what they 
learn. In other words, students cognltlvely mediate the Impact that 
teaching has on what they learn. By planfully manipulating cues -In 
the delivery facet, and influencing features In the content, evalua- 
tion, and setting facets, Mr. Jones tries to shape students" cognl • 
tive (Tiediations of instruction* In general, to be successful, a 
teacher must intentionally influence students* cognitive activities 
in lessons. But the teacher cannot cofttrol these cognitive activi- 
ties di rect]y--students cognitively mediate the effects of Mr. Jones' 
teaching. Let's return to Mr. Jones* algebra class to develop a 
model of students' cognitive inediations of teaching. 

A cognitive mediational model of teaching. The degree of 
in*^ respondence between each student^s cognitive mediations of Mr. 
Juntas' cues and his intentions for students* cognitive activities 
determines now effective instruction will be. At least four separate 
conditions must be met 1f this correspondence is to be achieved. 

Mri>t, in order for Mr, Jones* cues to function at all, students 
nust attend to them. Those who don't listen to Mr. Jones praise Jim 

I'^'i P'^'jinpt Md^y obviously can't be influenced to' shape their cogni - 
' )P»'rdti<)ns /js he intends. 

;^/CQnd, students must correctly perceive Mr. Jones* intentions 
-^>^Mnd nis cues. If, for example, students don't understand that Mr. 
.'j">'s wjnts tnem li) rehnar^e Jim's answer when he praises it, this 
nrfwr'^ function to help studeots acquire the content that quadra- 
, I'l ru» >r)]ved by 'jrdphing. Ur, if students don*t perceive that 
^-^'^ , 'M.^, w.'jnrs tne^n to add to their schema a routine that elaborates 
r /i^u-^ t f )r:nu]j is mvoWed, then his prompting of Mary^s 

r ',^-' ^ >n"*: r.p.^. n i^hat h<» .neans by complete retrieval of content. 

-.•>'^^^'> ni'^-'l * '> pHP. p]vf^ s UPS ({)rrH(,tIy fur tHrichuuj to work. 



Third, students who attend to and perceive Mr. Jones' two cues 
must be capable of carrying out the cognitive operations to yield the 
two cognitive products Mr. Jones seeks for them to create. If 
students can't remember all the terms in the equation when Wary 
answers, they won't be able to rehearse the content or feel pleased 
about acquiring It when Mr. Jones praises Mary, 

Finally, even if students attend to, perceive, and are capable 
of carrying out the cognitions Mr. Jones intends by delivering these 
particular cues, some simply may choose not to do It. These students 
lack motivation to mediate instruction as the teacher intends, 
instruction won't be successful for these students. 

A central feature of everyday teaching highlighted by the cogni- 
tive medlational model is that students have cognitive tasks to 
accomplish as they try tu learn from teaching.* This suggests a third 
lens for viewing lessons. I turn next to a model of learning from 
teaching that provides this perspective. 

Student tasks In learning from teaching. Students in classrooms 
have jobs to do. from their vantage point, they are responsible for 
decoding instructional cues and cognitlvely manipulating content to 
achieve mastery of the curriculum. As described earlier, content 
encompasses more than merely the declarative and procedural knowledge 
in a subject area. Students also are expected to develop self- 
reliance, to coordinate their wants with the rules of school's 
society, to build interest, and much more. Moreover, students are 
supposed to acquire schema to guide complicated thinking and behavior 
involved in problem solving, designing and completing projects, and 
so on. All these acquisitions are cognitive achievements that result 
rthen students engage in and successfully complete tasks. 

A tasit is something that the student must do. Answering a 
teacher's question, planning a session to study for an exam, and 
j'ist.'i in ing self -concept are tasks. Tasks are bounded by a set of 
inula! conditions and a goal. Tasks are worked through step by step 
iccording to cognitive plans, ^^me aspects of tasks are determined 
by variables in the facets of instruction over which the student has 
mnnndl control. For example, Mr. Jones determines whether students 
will work out equations with or without opportunities .to look back at 
the book. This variable comes from the setting facet^. Also, Mr, 
Jones determines how the task is introduced. For instance, he. might 
intend to prime students' memories either by a demonstration or by 
^!rQ/]..nng only a verbal explanation of what to do. As well, Mr. 
.i',ne: some of the standards by wh(ch students' work on the 

r 1 ,« v*i!I be judged, a variable from the evaluation facet. Here, for 
hH may or may not award credit for partially correct 

jin^T feature'^ of tne initial conditions, the yoal, and the 
Jy-idnics of accomplishing tasks are mostly determined by students. 
r jr I" *dnce. Students may be motivated to persist at solving equa- 
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tions even when the^ encounter difficulty. This varidble describes a 
iROtlvationdl aspect of their acquisition and retrieval operations. 
Turning to the evaluation facet, some students may feel good that 
they are persistent because this proves to them that they're trying 
hard. Other students, however* may evaluate their felt need to 
persist as an indicator of their ability. For them, talcing a long 
time only proves they aren't smart. 

A distinguishing .feature of tasics is that students use plans to 
carry out tasks. Plans are organized arrangements of schemata that 
students use to accoaplish tasks. Plans typically follow a general 
Sequence like this: (1) Compare the current status of cognitive 
accomplishment with the goal. Quit if these match within some 
tolerance of the standard or norm that applies to this task. If the 
current status is belOM the tolerance allowed^^try to characterize 
the differences to learn something about what needs to be done next. 
(2) Activate knowledge, motivations, and schema that, according to 
the plan being follow^, have some potential to reach the goal. Use 
these to operate on the cognitive products that make up the current 
status. Also, fint new content from either memory or the external 
environment ( a friend, stuff on the chalkboard) that can help. (3) 
Recycle to the first step. 

This cycle for carrying out plans to accomplish tasks is called 
a test -operate-test -exit unit or TOTE. Two tacit aspects of cogni- 
tive activities like TOTE's merit explicit mention. First, the goal 
for any single task is multidimensional. Alternatively, It could be 
said that there are many goals for any given task. Students approach 
tdSKS not merely to satisfy teachers' Intentions about instructional 
objectives. Inherent in tasks are students' feelings about them- 
"ieUes and the topics they are learning about, as well as opportuni- 
ties to practice and adapt schemata. Although a task like learning 
fro.T. a demonstration sometimes may seem to fc-us only on one parti - 
ciilar item of content, say a procedure for graphing quadratic 
cqjdti'jns, It inevitably involves all three categories of content. 

The second tacit feature of tasks is that they are jointly 
produced Dy -3 teacher and a student. Tasks are mediated cognitively 
by students. Students translate tasks teache.'S pose into personal 
f.ogmtiye representations via cognitive mediations of instruction. 
The initial conditions and the goal that bound a plan for 
iccompl i shing school tasks depend on students' attention, perception, 
!:<ipjt)i hties, and motivation. Thus, tasks that students pursue in 
sf,hool are inherently "their own" in every respect. 



' , f J nj. o! iddt ing the Models 

Tnese three model s--the CLDAKS modGl, the cognitive medidtlonal 
•iiofiMl uf ho«» teaching can impact learning, and the task model of how 
»t'jflHnts learn from teaching --describe instriiction from three 
different but interrelated vantage points. These brief sketches also 
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capture imo major aspects of contemporary research in instruc'.lonal 
psychology. The first is that instruction is riddled with 
Interactions. Although I omitted descriptions of hosts of su,h 
interactions researched in instructional psychology, the message Is 
clear: a representation of instruction that is ecologically valid 
will not be simplistic. Because these three models blend together in 
ways that point 1.3 interactions, they begin to lessen the distance 
between abstract research and accounts of idiosyncratic, real, every- 
day Instructional events. 

The second feature of my multi -model approach is that it blends 
together empirical research and theory from many traditions. For . 
instance, instructional objectives are linked to motivation by way of 
students' cognitive renderings of goals for the tasKs they pursue 
during lessons. Also, structural designs for content are linked to 
teaching skills via the conditioning factors of students' attention, 
perception, capability, and motivation in the cognitive mediational 
mode I . 



Summary and Forecast 

To this point, I have presented a set of three assumptions that 
set off my view of instruction from hosts of others and three models 
tnat describe instruction per se. Bie assumptions are: (1) cogni- 
tive activity Is inherent and patterned; (2) learning is a goal- 
onented cognitive activity; and (3) instruction is an intentional 
activity where teachers intend to influence students' learning. 

I nave attempted to diagram the three models and the ways t*"?y 
rnlrite to one another in the accompanying figure. One model, the 
f.ogni':ive mediational model, elaborates the dynamics of my third 
assumption regarding the intentional aspect of instruction. It irien- 
rifies four separate ways that teachers* <»ttempts to guide students' 
so.jnition can be foiled, bpeci f Ically, if teaches are to realize 
leir intentions, students must succeed at: (1) attending to cues 
jjout coynition; (2) correctly perceiving the nature of cugn1tiv»» 
^ ;r«, tndt the teacher intends to be engaged; (3) having avalloule the 
r^'Souf^.ffs n^f'ded to Cctrry out cognition capably; and (^) being motl- 
^ ti dcco"iplish these cognitive aciivifes. 

A second model, the tdsk model of how students pursue learning 
♦-.ffdcni nq, sxetches tne dynarmcs of instruction from the 
- i-nf.-,' point of view. This model describes three interlocking 
^ *-)• mt-, fit Ipdrniny ^ r./jsk: (1) the information available when 
nr.«: presented initially; (2) the goal toward which students 
!'-■ *') rt jr* ; ■ind [ i) cuqnitive plans that assemble resources and 
•jurnnHtH studf'nts' c Qfjn i 1 1 vfc attempts to reach the goal from their 

'f'f' tnirfj I'iU'Jy', CtUARo, identifies facets of instruction within 
Ln^> precf'-linq two act i on -or i panted models are lodcjed. CEDARb 
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IS an dcronymn for conteflt, evaluation data, delivery of cues, acqui- 
sition operations, retrieval (^rations* and setting factors. This 
model functions like a checklist. When planning for teaching and 
mhen analyzing teaching effects, information about each facet Is 
needed to put together a complete picture of what happened. More- 
over, as shown in my example of »r. Jones' teaching, interactions 
across facets are the sparks that animate the CEDARS model. Inter- 
actions are the pr-^per focus, not just each separate facet. 

So much for assumptions and models. How can we use these to 
promote cognitive achievements? The forecast of an answer is seduc- 
tively simple. Like everything else so far, it has three parts. 
First, make sure that teachers' intentions for students' cognition 
are realized. Do this by insuring that students succeed at attending 
to delivery cues, at correctly perceiving the cognitions teachers 
intend them to activate, at having necessary resources so they have 
the capability to succeed, and at being motivated. Second, support 
students as they pursue tasks, fki this by insuring that the task can 
be accomplished given its initial conditions, that the goal of the 
task is perfectly clear, and that students have a cognitive plan that 

work. Third, coordinate t*»e5<» two activities across all the 
fdcets of instruction. Do this by insuring that what happens in one 
facet does not Interfere with the events occurring in any other 
facet. Better yet, make the interactions among facets synergistic, 
dynanncally supportive of one another. 

Let's explore in more detail how this answer might take shape in 
reality. 

Promotiny Cognitive Achievements 

In this second section of the talk, I'm going to describe some 
^t^y^ of teaching that can promote cognitive achievements. But befort; 
! ;)n, Vm obligated to point out clearly that what I'm about to 
leicf-inH IS much an agenda for future research as it is a 
synthesis of select contemporary scienti f ic knowledge about instruc- 
M'jn. I ,^dfflit 'jp front that answers aren't yet available to our most 
M'ltr-jl 4 iH'it.ions about how to enhance teaching and learning. But we 
«; i «naw ihdt. Whdt I do claim, without hesitation, is that we now 
"ive ■ned'^s to approach truly significant improvements in schooling, 

drj other change in human affairs, this will take time. Inevi- 
•^r,lv, n will show some zig-zagqmg around an ideal path to improve- 

hdvf more to say on tins at the end of my talk. Now, 
-^iw.'^^T, with these caveats in mind, let's set aside these issues and 
'..f,r', , f rjomdin instructional psychology. 



>t*^ps T'lwdrd Realwi n^ Instructional Intentio ns 

of-Jinrj to the cognitive nediational model, four coynitivp 
' -I 'i^.'t'^nn ine wnether students will respond cognitively to their 
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teacher's delivery of acquisition cues and retrieval cues. These 
factors are students* attention, perception^ capability, and motlva- 
tlon. What sorts of steps can be taken to Increase the chances that 
students succeed at each of these cognitive achievements? A general 
answer to this question Is fairly stralghtfori^ard: teach students 
about the cognitive work that corresponds to Instructional cues* 
ril treat each of the four factors In turn. 



Gaining Attention 

Cues that teachers and texts deliver to students may not always 
be noticed. Occasloi^ally, cues that students know about are actively 
{<;jnored. For example, how many students pay attention to the various 
levels of headings when reading textbooks? Headings are acquisition 
cues, IXirIng classroom teaching, do students pay attention to 
teachers' cues that provide similar Information about how content is 
organized? For Instance, are overviews that teachers sometimes give 
at the beginning of lessons attended to, or are students otherwise 
busy getting out a book or finding last night's homework? 

Three key things probably determine whether students attend to 
cues. First, they may need to be told that particular teaching 
behaviors and features of text are cues to use particular cognitive 
operations* Second, students need to be undistracted by other events 
m order to pay attention to an Instructional cue. If other 
pursuits, like having the answers ready from last night's homework on 
quadratic equations, are more important for avoiding criticism than 
IS listening to an overview that the teacher is presenting right now, 
thpn we shouldn't expect students will pay attention to some cues. 
Third, teachers need to teach in ways that help to make cues salient, 
blowtn'j down, pausing slightly before and after cuing, modulating 
pitch and loudness of the voice or color of the chalk may help. 



^ 1 <j r 1 fy 1 ny Percept i ons 

There is much evidence that students don*t always accurately 
^iMfc^-ive what form of cognitive work to do after they've attended to 
ir^ n)^truct 1 ond ! cue. Consider one of the cue% prominently written 
:!Duut --teacher praise* After a student has answered a question or 
pnjrformed d task, a teacher might react, '^Well done, Mary." What 
.o^jHUiv^e v^ork is Mary supposed to do now: attribute her success to 
^*^turt, renearse tne content she just spoke, conclude that this topic 
. jn ru' rf^wdrlinq? Moreover, what cognitive operations does the 
•-j.nfT uiti^nd tne other studentb to engage when they supposedly 
to this interchange? 

As jnothpr h'Xdmple, hov* should students react cognitively to the 
/•"-y .'jn.ron cue delivered in textbooks ot questions inserted within 
■ f jM'.^v^Ti prifdi^rapns? Une possibility is to try to retrieve an 
1/;,**-^. Anowher i^ simply to do a superficial mental check to see 
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whether concepts mentioned In the question make sense op are still 
dyalldble in memory, Yet a third possibility is to forget trying to 
answer the question and go back In the text to find one. 

When there are alternative perceptions about how to respond to 
Instructional cues* it is likely that sme students won't engage 
cognitive operations that teachers or authors of text intend* Also, 
students sosietimes are so active in seeking cues about how to learn 
from teaching that they attend to and perceive an Instructional cue 
that their teacher did not provide intentionally. In other words, 
some students' perceptions of Instructional cues are "Inunacu lately 
conceived**— students judge they have been cued to do certain kinds of 
mental work when the teacher Intended no such thing. 

Lots of research has shown that students can be trained to 
perceive teachers' and authors' messages about which cognitive opera- 
tions to use in response to different instructional cues. Providing 
training like this seems to be the obvious answer to students' 
problems of unclear perceptions about instructional cues. Such 
training should focus on the procedural knowledge and schemata that 
f^aKe up plans students use to accomplish classroom tasks. I'll have 
more to say about this later when I describe steps to take to facili- 
tate tasks. 



Mdjdmizing Capabi lit^ 

Let's assume that a student has attended to an instructional cue 
and correctly perceives the nature of cognitive activity, that is, 
the plan that's appropriate for the task at hand. Knowing how to 
operate cogni t1 vely on content doesn't guarantee that the student 
•fill be capable of succeeding. The teacher must take steps to insure 
that students are capable of per*''"'*ming the operations necessary to 
Succeed at Instructional tasks. 

In general, there are two conditions to which teachers should 
dttend to mdxiinize students' capabilities to succeed at cognitively 
medidting instructional cues. The first condition is that students, 
;?k;e everyone else, are limited in the amount of information that 
tney cdin handle. Care must be taken not to overload the limited 
Cdpdcity of the cognitive processing system. One way to avoid over- 
loading the system is to design Instruction so that the students are 
not doing more than one or two tasks at a time. For instance, the 
t^acner ^no asits a tough question and then turns to write some new 
.ontent on the chalkboard during the ensuing silence invites students 
u^t.Tlodd tneir memorldl capacities. 

Another technique that can help to reduce the strain on 
ir.jdents' coynittve systems is to chunk together similar bits of 
ontent. If our Mr. Jones is working out a 'Quadratic Inequality on 
tn*' '-.nr) Uboard, thjt Is, demonstrating proced'jral knowledge, he may 
h*> ^"^<in'j students to work on too many chunks of content If he also 
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asKs students for definitions of terns associated with quadratics 
such as discriminant and leading coefficient that are declarative 
knowledge. 

The second condition that tears on students^ capabilities to 
mediate instruction Is the degree to which students have practiced 
tne taslc^ Instructional psychologists have ctemonstrated many times 
that students have a greater chance to succeed at learning when they 
can execute cognitive operationSr-automatically. The way to enhance 
automaticity is to drilU Drill doesn't have to yie>d rote^ non- 
meaningful learning. Non meaningful ness Is a property of what 
students learn, not how they acquire and retrieve it* So, in the 
case of students' cognitive mediations of Instructional cues, 
teachers need to do more than tell students to perceive cues 
dccurately. Teachers also need to provide students with extensive 
practice to make links between cues and associated cognitive opera* 
tions automatic* 



Motivating Cognitive Work 

fihen teachers ask students to mediate cues, students have to do 
cognitive work* Just because students know when to do what and are 
capdble doesn't guarantee that they* 11 ''bother" to follow the 
guidance teachers offer by instructional cues. Students need to be 
aiotivated. I can outline several techniques for motivating students 
in the abstract. Obviously, teachers will need to personalize these 
suggest Ions • 

First, If students don't know what outcome to expect when they 
f^njdqe In coynitively mediating instructional cues, it^s not likely 
thdt: they'll be motivated, Unpredictdbl 1 1 ty can mean risk, and risks 
dre often dealt with most comfortably by avoiding situations like 
.iSKincj i^uestions or offering opinions. Communicating to students 
wHit oiit( ome expectations apply in cognitlvely mediating instruc- 
cues IS one component in motivating students, 

Kno^iny the likely outcomes of different Instructional tasks 
t ,n*r. pnou^jh in niotiv^ite Students, though. Students also need to 
bnMeve thdt they are hkely to succeed at accomplishing acquisition 
i'^j retrieval tdis<s to uhich instructional cues refer. If students 
Hive 'aw expectations about their efficacy, they probably won't be 
writ^d to er}.j<5'je in the cognitive work teachers outline. What can 
ru^rs to increase students* efficacy expectations? Probably 
r)rnetiLial thiny is to insure that students are solidly 
iriiiHj ]n pldns for acco/npH shi tasks. Expectations for 

i .\ np^ tjsk. dliTiost alwdys are high when the new task is 
• ! * i' une tndt's r)(4?n completed Successfully many times before. 
In* r 1 H;; ^ n^»w ^."j^k hy pointinij out s i fin 1 a r i t i es between it and 
*3nd !';d^in'.j Sijre thdf; students hdve be^n successf:il on 
^r^»/i>iS ^.^s^'s d jood tnetnud tor rdising efficacy 
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There ts yet one more important dimension to motivating 
students. Suppose that a student knows the outcomes to expect for 
succeeding and for falling at a task. Suppose further that this 
student has a very positive expectation about being able to do what 
the teacher asks. Mill the student be highly motivated? Hot neces- 
sarily. Students, like others, attribute their successes and 
failures to different sources. For instance, success at a task might 
be attributed to luck or extra effort or an especially easy task. 
Failure might be attributed to being stupid, not working hard or long 
enough, or an especially hard task. Some attributions, like failing 
because of low ability, are not motivating. Attributions like 
succeeding because the task was so easy that anyone at all could do 
it aren't motivating either. In general, teachers can help motivate 
students by Insuring that students make appropriate attributions for 
successes and failures. Do not '*butter them up" by telling students 
they can do anything if only they'll try hard enough. Do tell them 
honestly why they succeeded or failed. And, whenever appropriate, 
focus students' attributions for their failures on sources that are 
under their control. 



Summary 

This finishes my set of suggestions that derive from the cogni- 
tive medlatlonal model. Here, then, are steps, point by point, that 
teachers can take to improve Students' cognitive mediations of 
instructional cues. 

bT£P 1 Tell students what instructional cues are used. 

^T[F I Structure presentations so that only one cue is 
del 1 vered at a time. 

■JtP 3 Make instructional cues stand out. 

STEP 4 Train students to know which procedural knowledge 
and schemata to matctj with acquisition cues and 
retrieval cues. 

bliiP b Avuid overloading coynitive capacity: present 
one task at a time and chunk similar content. 

,\'r b Drill students so that cognitive mediations of 
instructional cues become automatic. 

.VxV 1 students explicitly what outcomes to expect 

wnen cogmtively mediating instructional cues. 

Jr' j f^dximize students' efficacy expectations by 
telling them how new tasks are like 
previous ones at which they have succeeded. 
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STLP 9 Make explicit the sources to which students 
should attribute their successes and 
failures at tasks. 



Steps Toward Facilitating Instructional Tasks 

Earlier, I descrit>ed a model of how students approach learning 
from instruction. It characterized learning as a task. To carry out 
learning tasks, students activate cognitive plans to work on a set of 
initial conditions, transforming and adding to these conditions to 
achieve multiple goals* When our Mr. Jones asked, "itow can we solve 
for X in a quadratic equation?", he set a fairly uncomplicated task. 
The initial conditions here are the topic, namely, methods for 
solving a particular form of equation and a request for students to 
respond. Superficially, the goal appeared to be to name members in a 
category of such methods. 8ut as we saw, Mr. Jones applied criteria 
for dchieving the goal th^t went beyond merely naming methods of 
solution. He also prompted Mary to present the quadratic formula in 
addition to naming this technique. 

To accomplish tasks like this --or others like preparing a report 
about a chemistry lab, studying for a test, taking good notes, and 
having a productive di scussion--students need content knowledge. In 
particuldr, they need to comprehend both the initial conditions and 
the goals that bound the task. Then they require schemata that can 
bn activated as plans for carrying out tasks. I'll address each of 
these three features of tasks in turn, $ 



L om p r ehendi ng Initial Conditions 

Inere are two types of content that students need to master 
h-fore they can comprehend the initial conditions of a learning task. 
■ ilr^fiViy have spoken extensively about one of these, namely, the 
jjildnce thdt teachers intend to provide for students by delivering 
:n',';ructiond1 cues. If Students can't use instructional cues, then 
,1". i.^portdnt part of the Initial conditions of school tasks will be 
>■'■■■,, t'<i. My niessdfie here is simple: to promote cognitive achieve- 
•'•'"t, t.jKe the nine Steps just described. 

Ine other type of content students have to understand to compre- 
"Hi'i the imtial conditions of a task Is declarative knowledge about 
-n.ir tn^* tdsif IS. If I dsk you to Instrumental ly condition students 
r , ,n,i(iov« tH«r., do you hdve any idea what task I've set? I doubt it. 
wi'U' 1^, seems so obvious as to approach the trivial that students 

to <'\()w what the task really is, how many 10th grade students 
'"•iWy cump-ehend tasks like these: prove a theorem in geometry; 
-jo^1//e d hypothesis in science; interpret the meaning In a poem; 
..'•ijrdin d sortiny procedure for your (.omputer; or chardctPf 1 ^e a 
P'jlr.y of d .jovernment? Students nefj to know what the cask it and 
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wh4t they d) ready know about it before tackling the task Itself. 
This is what I mean by comprehending a task's Initial conditions. 

Comprehending the Goal 

A!) tasks have goals. As I described earlier, tasks almost 
always have multiple goals that relate t« the three categories of 
Knowledge, motivation, and schemata. Students need to comprehend 
what goals are set for tasks during Instruction. There are at least 
two significant reasons for this. The first is that a student's 
unrterstanding of goals Is a major determinant of the cognitive plan 
chat is activated to pursue a t«sk and of the criteria used to 
monitor how the plan progresses. I'm sure you're all familiar with 
students' constant desire to know when they'll be tested on material 
they read. The reason for this incessant clamoring Is not only to 
avoid low marks. Students use different cognitive plans when they 
read text for a quiz tomorrow than when they expect only to have to 
be conversant with the content* In particular, they rehearse more 
frequently and they rehearse different content in reading for a quiz. 
Thus, the way students comprehend the goal affects how they 
cognitlvely work on content. 

The second reason students need to comprehend the goals of a 
tdSH. is motivational. If students are not clear about goals, motiva- 
tion likely will be low. This Is because it is not clear what 
outcome to expect for effort that has. -to ba devoted toward accom- 
piishmg the task. A good illustration of this phenomenon can be 
seen when students ask, "Why do we have to learn about quadratic 
equdtions?" The same notion applies to the clarity of goals In 
history, yrammar, meteorology, and programming logic. Without clear 
tfj^pectdt ions about the goals of these tasks, it's-not clear why they 
should be rtor'iced on. 

f'u' remedy tor poor comprehension of goals for a task is much 
thdt for inUi<ai conditions. Students need to know what the 
^jOdls are for each task they undertake. Moreover, they want to know 
Mt\,ii conseq'jences to expect for their efforts. Both these kinds of 
. -I WW ! ..'(I'jH 4re deciardtive. Hence, students should be to'd what the 
of tasks dre before 'invi ting them to work on tasks per se. 



'^^ ji-'P. rridf. d Student comprehends the initial conditions and the 
,.);'. ;t ,j r^s*, what remains is to engdye cognitive plans to trans- 
* ,r ;i 'fiH imtidi conditions into the goal. Cognitive plans are 

1 vnps SI nple, but most often, they are complex. As is true of 
I'i :nf otn^ff *?nds of icnowledye, the schema that underlie cognitive 
. ,'in :)p tdu'jnt dirf?ctly. Tcdc'iir'y Students pljns for dccom- 

, ■ J "1 j instructional tasks has become d prominent are-i of research 
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In xne last ftaU-^i&i yeafs« What has teamed from this 
research can be summariaceii wry tersely as follows. 

First, plans Involve several steps. Each step needs to he 
taught to the point tHat H Is easjf to carry out. In other words, 
each step of the plan should t^come automatic This degree of 
mastery is necf>ssary so that stim^ts can devote their cognitive 
resources to operating on content according to steps In the plan 
rather than f1*^Lr;og out how to work out steps In the first place. 

Second, stuucnt^ need to see how the steps In the plan or how 
the plan as a whole can be used to approach goals of tasks. If part 
of a plan calls for stui^ts to id^tify si^lflcant features of some 
concept, they might be shown how this same step also will help them 
when they write essay answers. Identifying significant features of a 
concept during acquisition In class Isolates these for rel^arsal. 
Identifying significant features of a concept during retrieval In an 
essay test Item elaborates answers In ways likely to earn more 
points. Coordinating acquisition operations and retrieval operations 
like this is valuable. 

Third, students can't learn plans or become proficient In using 
them without practice and feedback that focuses <m the plan rather 
than a curriculum area. For instance, suppose one step in a plan for 
reading science text for comprehension Is using prior knowledge to 
interpret new content. Here, a student might mentally pause after 
reading each paragraph to compose an analogy between the content in 
the paragraph and prior knowledge. If the paragraph described how 
the shape of coastlines influences tidal volume, an analogy might be 
drawn to the topography of land masses and wind currents. Students 
need practice 1ti composing analogies like this and feedback to help 
them determine how good thel'- analogies are. 

To provide feedback, teachers need hard copies or traces of 
these mental analogies, perhaps obtained by having students record 
several analogies per reading assignment. In general, traces should 
provide clear evidence 2bout which cognitive activities were 
practiced by students and whether they were practiced at all. Traces 
also are essential as a basis for providing evaluation data about the 
quality of the student's cognitive achievements. Thus, traces of 
students' cognitions for teachers go hand in hand with practice and 
feedback about plans for students. 



Summary 

Tasks are the means by which students attain cognitive achieve- 
ments. To increase students' proficiency at carrying out instruc- 
tional tasks, teachers need to take steps to help students comprehend 
the Initial conditions and the goals that set boundaries around 
tasks. As well, teachers need *iO prepire students to engage in tasks 
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bj^ teaching cognitive plans* Here, point by point, are steps 
teachers can take to facilitate stu<tent$' accffinplishiaent of Instruc- 
tional tasks. 



STEP 10 Teach declarative {knowledge used to set a task 
before assigning the task, 

STEP 11 Teach declarative knowledge about the goals of 
a task. 

STEP 12 Teach students the plans they need to accomplish 
tasks. 

STEP 13 Make students capable of carrying out each 
step In a plan automatically. 

STEP 14 Teach the general utility of each step of a 
plan and of the plan as a whole. 

STEP 15 Obtain traces of the products of steps in a 
plan to insure that students practice steps 
and to provide a medium for evaluation data. 



Recapitulation About Cognitive Achievements 

In the preceding moments, I've sketched a series of 15 steps 
that teachers can take to promote forms of students' cognition. Each 
step has been targeted at affecting what happens during instruction, 
when teachers are teaching and when students are trying to learn. 
Coynitlve achievements of the kinds I've been describing that are 
attained during lessons are what make teaching effective or ineffec- 
tive. If students can reach these cognitive achievements, during 
instruction, then I believe we will have made substantial strides 
toward improving the overall quality of education. But I have yet a 
few more steps to add to this list before I finish this talk. These 
last few steps address means by which teachers may be helped to take 
the preceding 15 steps. 



Steps Toward Talcing Steps: A Beginning for Change 

At several points in this presentation, I've made note that 
tnere are difficulties that will imfwde taking the steps I advocate 
or that make the steps themselves tentative rather than sure-footed, 
before closing, I want to patch up a portion of these issues as I 
promised I would In my introduction. 

I do not delude myself with false hopes that you can return to 
your schools to put in place the steps I've outlined today. At the 
beginning of this talk, I asserted that Instruction 1s not simple. 
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I'm sure you'll agree that tte theoretical content I sketched In the 
first half of the talk Is not simple either. But It is essential to 
sketch these models to provide structure and reason for the steps I 
outlined to promote cognitive achievements. In reality, the three 
models I ^scrih^ are schemata that teaci^rs can acquire and use as 
plans to guide their instmction. It is «y firm belief, a belief 
based on teaching tf^se scheisata to undergraduates in a course and on 
the research about pre- and inservice teacher education efforts, that 
piecemeal workshops will not suffice to teach these schemata to 
teacfiers. A long-term concerted effort 1s,«^t*s needed. Hence, the 
place to begin implementing what I adv<^ated today is in teacher 
education programs. Teachers, just like students.need to reach 
levels of application that are automatic. This requires lots of 
drill, supplemented by extensive evaluation. Just as much care will 
be needed to design instruction for teachers as is needed for public 
school students. 

In the opening to the second half of this talk 1 specified that 
my suggestions pointed to needed research in the future just as much 
as they synthesized what Is already known. There is an important 
message in the fact that I can't provide unequivocal answers to 
resolve the dilemmas faced in today's educational system. The 
message Is not that research Is fairly useless, something to be 
called on to make impressive rhetoric and shunned in practice. 
Experience and good will, by themselves, aren't adequate either. If 
they were, the millions of hours logged by practicing teachers 
already should have provided almost all the solutions for which we 
are searching today. Rather, we need to encourage good research. 
Teachers, students, and professional researchers need to work 
together to create the knowledge we need. And school systems need to 
be not merely receptive, but active initiators of research. 

In summary, then, here are two more steps that need to be taken 
in order to promote public school students' cognitive achievements, 

bTtP 16 Kevamp teacher education curricula to Include 
features corresponding to Steps 1-15. 

blLH 17 Do research, either on your own or in collaboration 
with professional researchers. 
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"Teaching procedures rr^ust provkte &kx^ ^/ppcHl for Wscfwrs to 
use them as they are, ^ ftexHMy to alksw kyr te&c^rs to ta^r 
their instruction to their clas^ lnv(^vir^ classroom m^rs wf» are 
in the (grating system in the ctevebpmeru of <fte mtnx^mnai sy^m 
may help assure program ^pprcpf /afsness and acceptance! ' 



' The task of designing an integrated instructional and asse^ment sys- 
tem for critical thinkirg poses a formidable chal^rge. School systems 
must decic^ whether they want to wach critical thinking as generalized 
or curriculum-emt)edded skills, ^hods must also specify tlw sef of 
component skills the critical thinkir^ program will teach and test and 
the range of content and activities in which stuctents will use critical 
thinking skills." 
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DCSIUNING AN INT£GfUT£0 ItiSTRUCTIONAl AND ASSESSHCNT 
SYSTEM FOR CRITICAL TNINKINfi SKILLS 



Center for tlie Stu^ of evaluation 
University of California* Los Angeles 

and 

School of Education 
Stanford University 



The desire to teach students to fons reasoned Interpretations and 
evaluations of tlieir academic and personal ejqjerlences pervades educa* 
tlonal rhetoric. The philosopher, ftortliwr Adier, has called for 
renewed esphasls on critical thinking; the H&i York Tings devoted an 
educational supplesent to new critical thinking efforts, and even the 
Reader's Digest recently featured an article on how to think hetterl 

Clearly, the public expects- schools to teach students to think, 
not sl^ly to absorh subject^tter content. Although courses of 
study for most school subjects contain goals for teaching Inference 
and critlciss). and periodically there are special projects that attempt 
to develop critical thinking skills, for the isost part, these efforts 
have had little success In producing' classroom activities teachers will 
use systematically . Wot too surprisingly, evidence Is aountlng that 
students' Interpretative and evaluative skills are not well developed. 
The results of students' reading, thinking and writing skills by the 
National Assessment of Educational Progress (NAEP) indicated that few 
students at any age level could write essays In which they forsied and 
explained Interpretations of reading passages (NAEP. 1981). 

The problems plaguing atteinpts to establish critical thinking 
classroofli Instruction are varied and formidable. There Is little 
consensus on what critical thinking is, on how to teach It or on how 
to wasure its outcomes. Furthermore, despite the lip service paid 
to the need for instruction on higher-order reasoning skills, teachers 
and students may view critical thinking curricula as tangential to 
required courses ot study, as appropriate only for high ability stu- 
dents, or as too demanding of time and effort. To compound the prob- 
letr, administrative and economic support for projects has often been 
too Meak or short-lived to permit sustained critical thinking instruc- 
tion to becon% an established classroom routine. 

Thfc purpose of this* paper Is to examine som of tt.s problems in- 
volved in designing an integrated system to teach and assess critical 
thinking skills in the classroom and to describe attem(.C5 to draw upon 
research from diverse disciplines to inform the development of an 
ettective, viable pilot pr-^ject in the Pittsburgh public school system. 
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Backgrowd of tMe Monitor Aclilevefflent in Pi ttsburgh (MAP) Critical 
Thinking Project 

Before revie«ins research and theory that influenced the initial 
design of tDe HAP Critical Tninking Project, it is 1a|»>rtafit to know 
the events and perspectives that instigated it. The design of the 
Critical Thinking Project in the Pittsburgh Pul>Tic Schools Mas forged 
by two iMjor forces: the cossiit^nt of the superintendent* Richard C. 
Wallace, to use a aiastery learning approach to iisprove student achieve- 
isent, and our conviction that a program In which students wrote about 
what they read cculd provide a pt^^rtul trasiework tor developing disci* 
plined critical skills* as Mil as reading and writing skills. The 
charge to superintendent fr<»n the school board was to lead the develop- 
ment of a plan to improve achievement: a component of his strategy was 
to draw upon Bloom's fsastery learning B»(tel to focus, structure and 
c&ordiirate instruction, asses^nt* and staff development efforts 
(Bloom. 1968). Part of the asses^nt coii9>onent was to be a district- 
wide diagnostic assessment system a<&)inistered every six weeks, to 
Monitor Achievement in Pittsburgh (KAP). Our project joined other 
MAP projects in m^, writing, and reading to extend development of 
critical thinking skills. 

In the project, we have developed three separate, but coordinated 
components. The assessment component includes a set of diagnostic 
tests that ask students to write coii^osi tions about a reading passage. 
Teachers use a rating guide to provide analytic feedback to students 
on how well their compositions had a clear main point, adequate sup- 
port and logical organization. The instrMctional cofi^onent suggests 
general teaching strategies and provides model lessons. The staff 
development approach is used In the other MAP programs. During the staff 
development sessions, teachers work with project staff using research- 
t5ased techniques to develop, interpret and revise project procedures 
and materials. 

In 1982, we initiated the project with approximately 35 fifth, 
eighth and eleventh-grade English and language arts teachers. The 
goal of the six-month pilot project was to develop prototype strategies 
and fitaterials. In the fall of 19453, the project moved out of language 
arts into social studies. We began working with approximately 25 
teachers from the same grade levels to adapt the language arts proto- 
types to social studies. The project's development is still very 
fluid and formative. With this In mind, the paper will review some 
of the literature that bears on the project's form and substance, in 
particular, and on problems of designing critical thinking programs, 
in general. 



Definitions of Critical Thinking 

As a generic term, "critical thinking" seems to strike a common 
chord ot understanding. A close inspection, however, reveals that 
the general term translates into quite varied sets of classroom activi- 
ties that call upon diverse cognitive processes and knowledge structures. 
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Thr^ related, but separate bodies of literature sees) to have produced 
the ^jor concepts ot critical thinking. !n one approach, writers set 
out to define critical thinking and deckice more (or less) insightfully, 
the skills assuaed to c<Mipr1$e the construct ot critical thinking. Pro- 
posed taxon<»nies or hierarchies of leamfitg that Include skills related 
to critical thinking as part of their mre general analyses of cognitive 
complexity are a second s<Mirce. A third source Is the literature on 
Inquiry and problem solving "Skill developasnt. Work In each of these 
areas has Influenced specification of the skills proposed for critical 
thinking, the features of tasks used to teach and test critical thinking, 
and the Instructional approaches advocated for developing these skills. 



Analyses of Critical Thinking 

A nunber of writers have proposed finltlons and analyses of the 
critical thinking construct. Some of .c^ writers have looked to 
philosophies of logic and rhetoric to len y generalized thinking 
skills, other writers have lookec to the epistosiology ot a subject 
aoflJdin to Identify specific interpretive and evaluative skills; another 
group has derived its constructs from syntheses ot various perspectives; 
and a final group has simply announced ad hoc definitions and skill 
lists. 

Uewey's discussion of "reflective thinking" in hi* book How We 
Think , is a frequently cited definition of general critical thinking 
skills that transcend the particular conventions of subject doii»1n 
(Dewey, 1933). Dewey defined reflective thinking as the careful and 
persistent examination of an action, proposal or belief, and the analy- 
sis or use of knowledge in light of grounds which justify it and its 
probable consequences. He also proposed a five-step process that the 
critical thinker would use: I) identify a problem, 2} analyze a 
problem, 3) suggest possible solutions, 4} test consequences, and S) 
judge the selected solution. 

Another pioneer in the analysis and evaluation of generalized 
critical thinking skills, Edward Glaser. propose three con?)onent5 of 
critical thinking: I) an attitude of being disposed to consider in a 
thoughtful way the problems and subjects that co?De within the range 
of one's experiences, 2) knowledge of the methods of logical Inquiry 
and reasoning, and 3) some skill in applying these methods (Glaser, 
1941). 

8. 0. Smith also emphasized the judgmental dimensions of critical 
thinking is his definition, but limited their application to problems 
of logical reasoning presented to the student, i.e., "what a statement 
flieans and whether to accept to reject it" (Smith, 1953). In his land- 
mark paper, "A Concept of Critical Thinking," Ennis further elaborated 
Smith's view of critical thinking by delineating twelve skills involved 
in the "correct assessment of statements." Lnnis's skills primarily 
called tor the application of rules of formal and informal logic, in- 
cluding making judgments about the logic, validity, reliability and suf- 
ficiency of assertions and their underlying assumptions (Ennis, 1962). 
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other concepts of critical tlilnklng tiave attested to consl^r 
Us role In particular scfiool subjects. Russell, for Ittstance, dis- 
cussed the relationship of critical thlnklflg to the developoient of 
students' rM4ing skills. The eight skills he 1<teflt1t1ed are stIlJ 
Ulrly representative of tl^ Hats of <^jectfves c^aomly classified 
as lAterentlal or critical reading skills. They Include abilities to: 
1) abstract and organize Infortsation,. 2) draw Inferences, 3) search 
tor relevant laaterlals, 4) evaluate data, S} compare sources, b) dis- 
tinguish feet troa opinion, 7) detect propaganda, and 8) apply rules 
of logical reasonlrig (Russell , i96S). 

lhQm$, too, expanded the constellation of critical thinking 
skills from logical reasoning. Following an extensive review of 
critical thinking concepts and Instruction by Ih&ms and Taylor (1975), 
Thomas proposed as an operational definition that critical thinking 
Involved the use of logical or pragmatic criteria In assessing the 
reliability, relevance, sufficiency, validity or neaning of Information 
and also the use of evaluation strategies (Thoinas, 1973}. 

Hudglns also reviewed conceptualizations of critical thinking skills 
and attempts to teach thesi. He extracted four attributes conaton to the 
notions of critical thinking he had analyzed: 2} cotnprehenslon, 2} use 
of evidence, 3} evaluation of evidence and lines of reasoning, and 4) 
awareness of assuinptlons (Hudglns, 1977). In his view, critical thinking 
was "a general attitude of searching for evidence relevant to conclusions 
and that attitude must be supported by an array of Intellectual skills 
germane to the analyzing and evaluation of arguments" (p. 179/. 

In a recent review of varying concepts of critical thinking, NcPeck 
offers an extensive and thoughtful analysis and critique of prevailing 
vietts. McPeck dismisses atten^)ts to equate critical thinking and formal 
loyic as inappropriately rigid and narrow (McPeck, 1981). He also 
marshalls considerable support for his thesis that critical thinking 
rests upon field dependent epistomology , I.e.. knowledge of the belief 
systems of a discipline that provide rationales for allowable, legitimate 
moves from data to conclusions. In KcPeck's view, "Hhen a person knows 
how to suspend judgnwnt for the purpose of using his epistemic under- 
standing of an issue, and does in fact do so, we say of that person that 
he is a critical thinker" (p. 156). 

Throughout these conceptualizations of critical thinking run some 
comnion skills. These ipclude: 1) an attitudtnal Coo^onent, suggesting 
dn awareness, a disposition to be reflective; 2) an analytical component 
involving the identification of relevant information; 3) a component for 
Mi-iyhlng evidence; 4} a component involving knowledge of pragmatic and 
formal methods of reasoning; and 5) the act of evaluation. These analy- 
ses of critical thinking propose hypothetical constructs that call for 
empirical investigation. Few of these constructs have been subjected 
to Sustained inquiry, however. 
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Elements ot CwUIoh 



Scfteffles for classifying and se<^enc1ng coiponents of cognitive 
coB^lexlty also serve as fraiaewrks for discussions of critical thinking. 
In contrast to definitions of critical tto1iik1«g <ter1ved fr«8 Inftiltlve 
and logical analyses, faany of tiie proposed taxonoisles and skill hier- 
archies have arisen froa or led to empirical sidles. Interpretations 
conflict, however, over the validity of experlirental tasks and findings 
and their relevance to attenpts to define or teach critical thnking In 
classrooins. 

Piaget's stages of developsient, part1cula'"ly the distinction 
b€ft«een formal and operational thought, are often used to differentiate 
mong proiplems requiring critical thinking and also to Interpret per- 
formance (Inhelder S Plaget, 1958). Critics of this line of research 
contend that the artificial nature of the tasks- inakes It difficult to 
construct realistic or academic classroom critical thinking activities 
that Mould elicit paralle'. cognitive operations {Estes, 1978). 

Guilford's Structure of the Intellect has also Influenced concepts 
of critical thinking. Four factors relating to some of the 120 proposed 
intellectual abilities are hypothesized to underlie critical thinking: 
cosjftion. evaluation, convergent and divergent promotion (Guilford, 



Gagne s learning hierarchy is yet another source tor analyses of 
critical thinking. The upper levels of the hierarchy, where students 
use concepts, rules, and problem-solving skills, have been considered 
as skill elements of critical thinking (Gagne, 1977). 

Bloom's taxonoffy of cognitive objectives is the classification 
scheme most familiar to teachers and most used as a heuristic for 
defining critical thinking goflls. The levels of application, analysis, 
synthesis and evaluation have been used repeatedly to differentiate 
among levels of objectives, questions, and instructional activities 
(Bloom, 1971). 



More recently, Craik and Lockhart's notions of depth of processing 
have stimulated studies of how learners process information. In their 
scheme, deeper processing and therefore increased learning occurs when 
learners draw connections among pieces of presented information. By 
implication, higher levels of thinking are characterized by both the 
number and type of relationships or semantic networks formed (Craik & 
Lockhard. 1972). 

Sternberg has also suggested a heirarchy of cognitive performances 
inducing the components of inductive reasoning, encoding, inferr'ng 
relationships between terms, mapping higher order relations, applying 
previously learned relations to new settings, coB$)aring Mternative 
answer options, justifying one answer and combining elements into stra- 
tegies {Sternberg, i9«l, 1983). 
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Only sffiiie of these attalyses «f eleneots of tniiiklns or cogAttlon 
pertain to concepts ot critical thinking. Sosie notions of critical 
tninKlns that reference the upper leveU of these helrarchles, for 
example, do not seen to dlstln^lsh cosiplex reasoning froiP the "crltl 
car eva)yatl¥e aspect* 



C ritical Thinking and Probleis Solving 

The line cf research on Inquiry an^ prohleis solving also relates 
to concepts ot critical thinking. While typologies of thinking or 
cognition focus on identifying kinds of sental operations and their 
relative complexity* Inquiry /prohl^ solving research focuses nore on 
the patterns and sequences In which these coi^onent skills are used 
to solve pHblem. Theory and research In the problem-solving litera- 
ture is probably the most advanced In helping to differentiate general- 
ized probleia-solvlng skills fr«B procedures and heuristics unique to 
the epistoinology of a discipline. Research on the processes experts 
use is providing evidence of a separate, executive program. I.e., 
experts' self-conscious supervision of the strategies they use as 
they plan, execute, monitor and revise the procedures they are using 
to solve a particular task (Chi, Glaser. 4 Rees. 1982; Slroon, 1981). 

In definitions of probleo solving or inquiry, skills such as weigh- 
ing evidence and s-iking judgments or drawing conclusions also appear. 
This literature adds to an identification of skill coaponents and hew 
they are acquired and iiBplemented. Discovery of problems and explana- 
tion of alternative solutions are stressed. Within this paradigai, 
Bruner. for exanple, stressed the value of having students use the 
particular inquiry roethods of academic disciplines. He identified 
a set ot inquiry skills that included getting and using inforiMtion, 
going beyond given information and understanding what makes that 
possible. He also asserted that children should be at least as self- 
conscious about their strategies of thought as they are about their 
dttefnpts to commit things to memory (Bruner, 1966, p. 95). 

Suchman stressed the value of an inquiry process that is initiated 
and controlled by the learner. His main goal was for students to be 
conscious of the inquiry proc*»ss. Components of that process included 
tfie analytical skills ot verification and experimentation and the in- 
ferential skills developed by questions ot necessity and synthesis 
(Suchman, 1965). 

for Covington, divergent thinking involved in the inquiry process 
was so important that he deliberately addressed analytic, synthetic 
and evaluative skills in non-traditional subject areas (Covington, 

Taba, on the other hand, grounded development of the inquiry 
skills ot concept formation and inference and application of principles 
in a social studies curriculum (Taba, 1963). In a review of inqulry- 
priented curricula. Cornbleth identified six elements of inquiry: 1) 
doubt, i:) clarification, 3) hypothesizing, 4) reasoning, 5) testing, 
and C) reaching conclusions (Cornbleth, 1978). 
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One of tt)e isost profoumt Influences on current efforts to con- 
ceptualize and teach cognitive skills and on our project's inltldl 
efforts to fonaulate a working definition and fr^work for critical 
thinking was tUe work of tiei^ll and Siaon {1976). Tiieir studies have 
Indicated tnat probl^solving involves recursive attempts to discover 
a satcn between tnings oentioned in a problem stateisent and the scl»sa 
and operations storeii in msiofy. As Sioion describes tne process, tite 
probleot so!ver first fiust umterstand the pr^lem, tiien activate a pro- 
cess of detecting differences, finding relevant operators, applying 
the operators and evaluating progress. Eventually, the expert routinely 
recognizes the situation (problem type) and the appropriate pattern of 
"fiK>ves' (SImoA. 1981). 

These analyses of problein solving have exerted consitterable In- 
fluence on methods used to stu^y the processes skilled and unskilled 
rf^aders and writers use to understand and pro^ce discourse. For 
exan|>le. planning, construction, evaluating and revising have been 
used to characterize reading and writing processes (firown, Cafl^ione 
& Day. 1981; Hays & Flower. 1979; Scardamlia & Berelter, in press). 

Also, researchers in these areas have attet^ted to describe more 
consistently the elements of "problem types" presented to readers and 
writers by turning to theories of discourse structure (Kinneayy, 1971; 
Toulinin, 195b) and by developing discourse analysis scheines (Meyer, 
1975). Toulffiln's ai»a1ys1s of the argiflnentative Biode Is particularly 
useful for identifying ele<«ents that students would include in their 
expression ot a critical thinking task (their essays). Toulroln pro- 
poses that all arguments have essentially the saise structure and 
otters d "lay out" ot the cos^onents of practical arguinent. The 
structure Includes*. 1) claims-- a position or generalization, 2) 
data--ev1dence, 3i warrants— explanations of how data relf.te to the 
position, 4) backing—explanation of conditions, and 5) reservations 
and quallfers— Indications of the writer's degree of conviction 
(Toulflfiln, 1958). When students are asked to explain their evaluations 
and interpretations in classroom activities, then, we might at least 
expect them to use the elements of claim, data and warrants. 

Research on problem solving has developed along with a theory 
ot Intormation processing. The coordinated theoretical and empirical 
work In this area form a very credible framework for defining and 
devt-loplng critical thinking skills. 



The MAP Critical Thinking Projects' Developing Construct of Critica l 

Thinking 

As we initiated the project in the language arts domain, our 
working definition of critical thinking was that critical thinking Is 
a deliberate act in which students select from alternative strategies 
to achieve a purpose. We further proposed that critical thinking 
develops in the skill domains of reading and writing as students learn 
to analyze and evaluate text. Ue have continued to adapt those views 
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as He design project c<»|}onefits to fit within tiie SM:1al studies 
currlculun. 

From the preceding review, we can see that a nodi fled working 
definition and framework for teaching and assessing critical thinking 
CAP drsm fro» each of the tx^fles of ilteratttre. frcm analyses of 
critical thinking as a "problesi type," eiserge a set of iteflnlng charac- 
teristics of critical thinkliig. First. to.he "critical/ thinking 
tasks or pn^len types seen to be those ^t call for making a judg- 
{Rent, drawing a conclusion or .forging a relationship. Thus, the goal 
of critical thinking Instruction sight be descrlted as the "e^qiresslon 
and explanation of an assertion.'' Furtherstore. we i^ld expect the 
discussltm or essay In which a stud^t expresses and explains his 
Interpretation or evaluation of text to contain at least the basic 
stmctural elesffints of a well-foroed argument. I.e., a claim (fsaln- 
polnt). data (evidence), and warrants (explanatl^s of the relevance 
ot evidence to the claim). As V^Peck suggests, the task should permit 
more than one justifiable answer and the good answer should be judged 
Oft the quality ot the justification (ttcPeck* p. 149). 

If we refer to taxonomies of learning, we can extract from them 
some key cooponent skills which students would seem to r««ed to master 
In order to form and defend their positions. These include component 
skills or operators such as c<^rehens1 on/ verification of required 
information and bases and strategies for classification and Inferences. 
Furthermore, these component skllls^may serve as enabling skills for 
fashioning and explaining the end goal, and evaluation or judgment. 
Finally the problem^solvlng literature suggests that a set of con- 
scious, recursive, basic strategies underlie the develoimnt and self- 
regulation of critical thinking processes: The meta-cognltlve pro- 
cesses of planning, constructing, evaluating and revising. 

A definition of critical thinking that uses terras familiar to 
parents, teachers and students, might be, "the deliberate process of 
constructing and explaining interpretations and evaluations." The 
elements we expect students to Include in their constructions are: 
topic statements, credible evidence, explanations, and conclusions. 
The process of critical thinking involves:, planning, constructing, 
evaluating and revising strategies; skill domains or "problem types" 
might Include: sunM»ari2ing, classifying, inferring, and evaluating. 

Furthermore, for the critical thinking process to bec<»ne a 
routine approach, the processes of planning constructing, evaluating, 
and revising should serve Xmo functions. 1} to help s^dents develop 
habitual patterns of approaching critical thinking tasks, and 2* to 
help students develop a reflective, self-monitoring strategy for 
thinking about how they successf uVy use the'ie processes. 



Assessment ot Critical Thinking 

A ni^ber of factors influenced our design of the assessment 
component. First, we came to the project sharing the district's 
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€OffimttB>e»t to tite vfew of Assessnoftt as tn tittegral pftrt of the in- 
struct tonal systea. We were in coosplete accord wltii ttte other MAP 
projects and ttie mastery learning soitel that tfie function of the 
assessment was to monitor pn^ress, dla^ose problens. Inform Instruc- 
tional 4te€ls1on making and prov1<ie fim»tl¥e evaluation for pr^^m 
li^rovement. 

One Implication of this view is that testing should match Instruc- 
tion—what Sfclnner had described as one more unprompted trial of the 
terminal behavior (Skinner, 1968). Like the 1ns^*ttct1onal activities, 
then, the assessment must also permit students to construct and explain 
their Interpretations and evaluations of what they read. 

In order to design assessment forms for each of the skill areas 
(summarUe, classify. Infer, evaluate), we drew from methods of detain 
referenced testing. I.e., defining the characteristics of text passages 
and questions that would ^i4e writing the tests (Baker. 1974; Hively, 
1974; Fopham, 1978; Qtffillmalz. 1978). One of our goals for the j>ro^t 
was to specify task domains so that we could develop a homogenems pool 
or bank of activities /that could be used for Instruction or asseltsment. 

Another 1fflpl1cail<m of the v1«« of testing In the service of In- 
struction Is that the diagnostic function would provide maximum Infor- 
mation by presenting an analytic profile of the essAy. Therefore, the 
project adapted the hybrid holistic/analytic rating strategy developed 
as part of the Mr 1 ting Assessment Project at the Center for the Study 
of Evaluation (Quellmalz. Capell, St Chou. 1982). The intent of the 
guide Is to provide information on the essay cog^onents of focus, 
support and organization, as well as a holistic judgment of how well 
the essay orchestrates these components to address the assignirant 
(Quellmalz, I9bl). the resulting score profile enables teachers to 
focus class and individual Instruction on areas requiring further 
development. 



Critical Thinking Instruction 

As we might expect, the broad spectrin of critical thinking defi- 
nitions has fostered a variety of attempts to teach these skills. Some 
Instructional efforts focus on strategies for critical thinking systemic 
to a particular discipline, others allege they promote general izable 
critical thinking skills. Programs differ in their scope, as well as 
in the nature and amount of support they provide In the way of teaching 
strategies and Instructional activities. Critical thinking projects 
also vary considerably In their atteapts to link teaching procedures to 
instruction and assessment. Unfortunately, data documenting a programs 's 
implementation and effectiveness are often absent, incon^lete or based 
on poorly developed or selected fl^asures. 

The design of the instructional component draws from the literature 
of instructional design and learning research those techniques which 
had the strongest research base supporting their usefulness In teaching 
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c(»i9)lfex reasoning skills In tfffi classroom. Although o«r gon^ral ap- 
proach Incorporates technj<}ims dram from leamfna theory and research, 
the specific Instructional strategies and isaterlai fonsats continue 
to evolve frcm our collaboration with district teact^rs and staff. 



IwpHcatlofls of Cognitive learning Research for the Design of Critical 
Thinking Instructions 

Critics of the tehavloral model for designing Instruction have 
objected to Its tendency to focus cm lower-level skills and to Its 
view of learning as a passive. Input-ou^ut process. Cognitive psy- 
cologlsts have rejected the einphasls of behaviorism on overt, observable 
responses at the expense of covert, hypothetical mental operations and 
knowledge structures that cosine to produce observable responses. 
Cognitive psychologist's view of learning as a constructive, generative 
process In which the learner assimilates new Infortsatlon Into existing 
knowledge trasieworks or schemata has procfajced research findings which 
are particularly relevant to the design of critical thinking Instruction. 

First, the cognitive paradigm revives the distinction between the 
psychological processes involved in recognition vs. production and 
corroborates the greater diagnostic value of constructed response 
measures—a distinction particularly ifliportant to critical thinking 
information. 

Second, studies of instruction in text cou^rehenslon (e.g.. brown, 
Uinpione & Day, 1981), and writing (e.g., Scardamalia * Bereiter, in 
press), reveal that students can learn to i^rove their planning, 
executing, monitoring, or revising skills. There has been less class- 
room research however on inq)roveH»nts in dwwin-independent, meta- 
cognitive skills where students "step back" and reflect on the state 
of their own knowledge base and strategies available to face task 
demands. These meta-cognitive skills are similar to the self awareness 
Bruner recommended that children should have about their own strategies 
of thought (Bruner, 1966). 

Tne implications of cognitive research for critical thinking 
instruction, then, are that students might well benefit from instruc- 
tional activities in which they practice and receive explicit guidance 
in strategies they might use to plan, construct, assess and revise 
their Interpretations and evaluations. Furthermore, these instructional 
and assessment activities should emphasise constructed responding 
and still use the core instructional techniques of orienting stimuli. 
Instructional cues (particularly modelling), practice and feedback. 
These instructional variables continue to surface as effective techniques 
in C09nitive training studies (e.g.. Brown, Can^ione, & Uay, 1980). 



Approaches to Critical Thinking Instruction in the MAP Critical Thinking 
Project 

Our general instructional approach has been to design lessons where 
jtudtnts express their understandings, interpretations and evaluations 
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of passages by engaging In the process of planflfng, "dofng," H.e.. 
reading » discussing, writing), evalaatfng and revising. Typically, 
students are presented wlttt a writing or discussion ass1gmi»nt for one 
of tfie four skill areas (susaurUIng, classifying. Inferring or evalua* 
ting}. Following tlie tectel^s of liunter's l/os^^lon aodei; 
students are presented with the objective of t^ie lesson in order to 
focus their attention on the goal. Setore reading, the teacher inay 
"elicit appropriate schesata" ^ough an Introdt^itory discussion of 
students' background Infonaatlon about the content of the passage and^ 
when appropriate. Its source, (e.g., a biased observer) or structure 
(e.g.. an editorial or a ^Hr^ entry). Sti»lents plan to read by using 
strategies to detenalf^ what Information In the passage would be most 
relevant to the writing asslgnnent. After reaiHng, students review 
passage content to check for coisprehenslon, then engage In a variety 
of plann1ng-to-«r1te activities that Include discussing and outlining 
relevant evidence. The students write the essay* It Is evaluated by 
the teacher or students according to scoring guide criteria and may 
be followed by a revision activity fMused on one cr more eleiKnts of 
the essay or on the procedures students used to find and Incorporate 
appropriate Inforinatlon In the essay. The Instructional techniques 
of teacher Input (cues and models), practice and feedback then are 
Included In the Rtodel lessons as they are appropriate to the class's 
skill develofment level. 

A major contribution of cognitive research to our approach to 
designing the Instructional and testing systems has been the notion 
of distinguishing among task or problem types. Like the specification 
of assessment problems. Instruction on critical thinking, then, must 
precisely link the required "thinking" skills to the bounded problem 
domain. 



The Context of Critical Thinking Instruction 

Perhaps one of the most essential, yet neglected factors in the 
design of a critical thinking program Is the institutional context 
in which the program must operate, ^^ny of the Innovative programs 
developed in the ig60's failed to survive after specialized support 
dnd funding ceased. This may have been due, in part, to the programs' 
failure to consider aspects of the organizational context. 

At the classroom level, the problems could Include a cumbersome 
managerial system, an orientation at odds with the philosophies of 
the teachers or curriculum, or content that Is viewed by teachers and/ 
or students as tangential to required course goals or that is con- 
sidered boring or irrelevant. Also the program may not provide suf- 
ficient guidelines, supporti nj? materials or consulting help. Con- 
versely, the program may <iave been designed to be so 'teacher proof" 
that the activities do not permit sufficient flexibility to meet the 
needs of different teaching styles and groups of students. 

Studies of the in?)lementation of innovative programs at Rand 
and, analyses of implementation data from the Follow Through Project 



Ifutlcatei} tfiat variatlfms in the use of a single program wf tlilii eacA 
site iitere as great as varfatfons betiieefi sites (tenoan & ^^ugftlln, 
i977; Keimetbr, 1978). The ts^iHcatfOfi of these findings Is that 
teaching proce<lyres must provldte ei^ygh st^ert for teachers to use 
ttmm as they are* jfet escstgh flexIblHIiy to allow teachers to tailor 
their Instruction to their classes. Another lB|)llcatloos Is that 
Involving c)as$ro^ teachers who are In the operating ^st^ In the 
develojHsent of the Insmtctlonal system say help assure program appro- 
priateness ami acceptance. The HAF projects use such a collaborative 
strategor as one of their ctevelofsaent techniques. 

At the Mhool and distrvct levels, the progr^a may not receive 
the support of a^nl strati ve staff. This may he tte result of poor 
cofflQunlcatlons or the lack of support for tite program froiB other levels 
of the adnlnlstratlon. In Pittsburgh, the MAP projects address skills 
Identified In a district-wide needs assessment and then mamteted 
the school board. Therefore, tiiey receive full a^lsrlnlstratlve support. 
In fact, we are fortunate that Pittsburgh's district context has mai^ 
of the features Sank and Williams (1981} describe as characteristics 
of "heroic" districts that manage to use testing to Iq^rove Instruc- 
tion. S&se of these features are: 1} the support of anidea chanplon, 
2} a commitment to testing In the service of Instruction, 3) and a 
strong staff development program. 

In sum, program failure can often be traced to context Insensltl- 
vlty. By developing the project Mithin the school district, we are 
trying to build a program sensitive to district concerns and strengthened 
by the talent and expertise of Its personnel. 



Analysis of Resources for Teaching Critical Thinking In the Classroom 

The reviM of resources available for teaching critical thinking 
i.i the classroom, examines several elef!«nts: 1) the skills proposed 
as elements of critical thinking, 2} 'the kinds of tasks set to elicit 
the skills, 3j the inter-relationships of teacher training, instruc- 
tional materials and assessment, 4) use of research-based instructional 
techniques used to teach the skills in relation to ones which we had 
identified with a research base, 5) the role and structure of assess- 
ment activities, and 6) whether there was evidence of the effectiveness 
of skills development, variations in instruction, and acceptance by 
teachers and students. 

Resource, developed to teach critical thinking skills in the class- 
room vary along a nun^er of diRiensions. One distension is the intended 
function of the resource. The resfHirce may be a curriculum project 
wMch presents teachers with strategies and activities to achieve a set 
of specified outcomes. These projects can further be differentiated 
into ones embedding critical th1nk1n9 within a standard school subject 
such as science or social studies, or ones designed to teach generalized 
critical thinking skills. 
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lA-servlce. sUff <tevelopBiejit progrjoss are another set of resources 
developed to telp teadiers teacfe critical tninfclng In ttie classroom. 
Tnese staff devel(^ot pro^cts may also ettlier focus on a variety of 
techniques for teacMns critical reasoning skills, or be limited to 
questioning techniques. 

Soiae textbooks present gui^llnes for teaching critical thinking. 
These may revlai critical thinking concepts and studies of critical thinking 
and describe exemplary techniques. Others present one particular program. 
A third text type presents questioning strategies. 

The last resource materials are courses of stt»3|y and sets of 
objectives. These materlaTs differ In the range and Interrelation- 
ship of critical thinking skills proposed. In focus, and In the amount 
of guidance and supporting Information they present for Instructional 
strategies and activities. 

Because of the array of resources potentially relevant to critical 
thinking Instruction, this review mily considers curriculum projects 
with certain cl»racter1 sties. Of most Interest are resources designed 
to be used by teachers and stu<tent$ and that attempt to deliberately 
train the development of critical thinking skills. AlthiKigh some of 
the particular techniques and Instructional materials In the other 
resources may have io^illcatlons for classrww lessons, experience also 
suggests that teacher wrkshops or cwirses of stu^ and textbo^s. In 
Isolation from on-going curricula, have a low probability of classroom 
application. 

Unfortunately, In many cases, copies of the manuals and student 
and teacher materials ot curriculum prograas i#ere not available as 
primary sources for these programs. Therefore, this review often had 
to rely on descriptions of the projects in secondary sources. These 
descriptions often did not provide Information about important f.rogram 
features. In the aggregate, howver, the program descriptions allowed 
reasonable comparisons between the initial design of the HAP Critical 
Thinking pilot project and other efforts to teach critical thinking 
in the classroom. 



Curriculum Projects 

A nwnber of curriculum projects have attempted to foster critical 
thinking. Hudgins (1977) reviews studies from the 1930*s and the 1940's. 
He describes a program designed by H. Glaser in 1941. Glaser developed 
a semester English course ot eight units promoting skills related mostly 
to logic or detecting propaganda. The program was inserted into a regu- 
lar English curriculum, but the materials were only remotely related to 
the usual method of analyzing essays and newspapers. Hudgins does not 
describe the nature of the materials or the instructional techniques 
other than to indicate that Glaser provided a complete set of materials 
and references for reading. Apparently, with "careful planning" the 
teacher could present a self-contained critical thinking program. In 
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GUs«r's stu<|y of the prosras, tto ei^rfffientftl classes outperfenne^ 
control classes on an umtescHted test. Ho inforsation ibout teacher 
and student reacti«is to the pregrw was reported. 

In the 1960's asd e^ly i97&*s e nuisher of cur^culus predicts 
appeared using an "IsoNliry" approach. AimNis those ttslng the approach 
to help sKKtefrts (tet»l<H» sitills in the sclefittfic foethod «fere the 
Biology Science Currtciiltm and the AAA Science: A Process Approach . 

7TissOF53OTiTJS5iTTos'5sented stiaimu%ithn^atdi*^ aelfvui«s 

where stttftents "dlsco^^red" scientific principles of tim «ihject 
doBaln. Evaluations of tirase projects did not appear In ti^ published 
literature. alth^High a f&i writers sog^ted that tl^ programs' pro- 
cedures often distracted s^dents fr<HQ the Interned ot^tcotnes because 
students becaaie fascinated with the laboratory equlpisent. Critics also 
felt that the discovery processes were unnecessarily tlme^consunlng. 

Suchman's Inquiry Training Progras (1965) was a fairly well- 
documented imjuiry-orlented science program. The program was designed 
to help sixth-grade eleiiientai*y students discover basic physics princi- 
ples. The 24 weeks of Instruction presented flls clips demnistrating 
physical phencsaena which stedents first watched and ^n tried to 
explain. Students then asked a series of "disciplined^ questions. 
During the three stages of a lesson, students were encouraged to ask 
verification quesltons ciurlng episode analysis (understanding elenients 
of the problem}, qt^stlons to determine relevance during the next 
stagf and. finally. Inferential questions trying to Induce relational 
constructs. The teacher's role was to provide feedback through "yes" 
and "no" replies. The program had an eight week Inservlce program to 
train teachers how to Interact during the lessons. The progam measured 
Its outcomes by looking at students' concepteal mastery and application 
of the physics principles and by analyzing protocols of the questions 
students asked about a film. Students in the experlmentel classes 
only outperformed control classes (which had viewed the same film 
but were taught the principles directly) In the ntanber of verification 
questions and in the totel nifflber of questions asked. These results 
provide some weak evidence that students can be encouraged to self- 
initiate initial portions of the Inquiry, Information seeking process. 

Social studies Is another subject In which curricula tried to 
foster critical inquiry. Bruner's Man, A Course of Study , was one 
such program; Taba's elementary social studies program Is perhaps most 
often cited. Taba's program en^haslzed social studies concepts and 
inferences. Teacher training was carefully designed to reinforce 
procedures in the curriculum and criterion-referenced program tests 
were developed. In a year-long field study, experlmentel classes 
did not significantly outperform control groups, but Ruethodo log leal 
problems in the conduct of the evaluation may have obscured differences. 
In addition, the evaluation did not collect observations or Interview/ 
ruestionnaire data about the implementation of the instruction, there- 
for, it Mas difficult to interpret results. 

Other curricult^ projects couched their instruction on critical 
thinking in non-school subjects. Covington's Productive Thinking 
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Program followed tfi« genera T approach of the otner Inquiry pr^rasis, 
tHit was purposely divorced from traditloital subjects (Covington. 1968). 
The "Making Jud^nts** Progrwa ^veloped Thomas and his associates 
e^«dded Its Instructl^ In critical thltftfng In c<mm occupational 
areas where es^lc^s <sust evaluate In^^ii^ dcc^1«§ te knoMm 
rules &r conventions. This program produced a five-unit package on 
techniques of advertising, causation In research studies, conflict In 
arguments, evidence and testliaony In the courts, and facts and opinions 
in news reporting (Research for Better Schools, 1979}. The lessons 
were sel f-progrffiixKd books Intended to he seif*a<to1n1stered and paced 
and were accoi^anled hy pre* and post-tests. Th^s reports that pilot 
data shoi^d experloental students (Hi tper forming control groups and 
that interviews with students and teacNrs and classro^ observations 
Indicated a positive reception of the program. An external evaluation 
ot the progrdm by Baker, however, using tests froR the program and 
specially developed criterion referenced tests, showed less clear-cut 
advantages (Baker, 197^}. 

Several major curriculum projects, particularly the Illinois and 
Cornell Critical Thinking Projects, attempted to teach critical thinking 
as logical reasoning. In the Cornell Project, for example, secondary 
students received written exercises of 1-2 pages which presented defini- 
tions of terms and brief problems asking students to practice such 
skills as labelling premises and conclusions. No evaluation of the 
project's effectiveness, use or acceptance by dassroosi teachers was 
found in conventional published literature. 

Hudglns describes short term (five lessons) programs by Imo 
students of Peel that attempt to teach thinking skills to adolescents 
by having them analyze the logical aspects of verbal problems. The 
program presented brief exercises and multiple choice questions about 
their analysis. Both studies showed significant gains by the experi- 
mental students over controls, but no evidence of transfer (Hudglns, 
1977). 

in yet~^crther attempt-to -teaclr^thfnkfng skt 1)5, £tord-de-9ww 
devised the CoRT Project which aimed to give teachers a general frame- 
work tor helping students use particular strategies or tools. These 
tools are unusual representations cf a potpourri of Informal heuristics 
tor viewing arguments. The procedures have names such as "the bird 
watching method" or the "north-south method" in which students are to 
use a tool called ADI where they look in the direction of Agreeasnt, 
then Disagreement, then in the direction of the areas of Irrelevance, 
the Instruction uses a "tell, show and do" approach in small group 
discussion where students respond to a set of problens calling for 
use of the tool. DeBono described a series of studies of the program 
with students of various ages. He analyzed protocols of discussion 
sessions and reported that program pupils made fewer initial and in- 
stant judgments and were more inclined to generate points on both 
sides ot a question. Oe Bono also listed student and teacher coiranents 
Indicating that stulents felt they thought more "deeply" during the 
lessons, were not cjnscious of using the techniques in their other 
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sclio^l subjects* Imt <lf<f sot sees to (tse the tecimiQties out of school 
(Oe Bono, i976). Trfpp also refNtrted a foriMtftre evaluation of the 
CoRT progrsB In which pupils proihiced nore l^s of an apparently 
higher quality, tmt closer analysis revealed that. In some cases, 
the^ 14eas were not ^^ate4 hy usIas the pr^i^'s "thl^lng" 
tools and that the sU'uctureO dlscussifms alone, withmtt training on 
the tool ml she have produced the results (Tripp, 1980}. 

A series of fairly recent projects Is beginning to receive 
attention* Aidong these are Project Is^ct which focuses on role- 
playing, probleoi-solvlng situations In a local coMunlty context, 
materials baseil on Guilford's structure of the Intellect proved by 
the S0{ Institute, and lessons on strategic reasoning by Innovative 
Sciences using six proble^solvlng techniques st^gested by Albert 
Upton. 

In general, aiost of the program reviewed have not succeeded 
for a number of reasons. First, isost projects, perhaps with the 
exceptions of Suchisan's and Taba's progr^uss, were not accepted as 
regular courses In the school curriculum. This may partly be due 
to the development process, i.e.. the projects were developed outside 
the system, and partly because of the artificial nature of ^e 
tasks. Second, many projects did not provide sufficient Instn^tlonal 
materials and strategies for teachers to use or adapt the pros^^ 
readily. Third, In many Instances the instructional designs of the 
programs did not seem to use core Instructional techniques systema- 
tically, particularly Instructional cues, and modelling; most programs 
also did not tend to provide practice and Instruction on all aspects 
ot the thinking process. I.e., planning through revising. Most of 
the programs did not provide Instructional experiences of sufficient 
length and scope to move students through stages of Initial skill 
acquisition, development, and tmilntenance, let alone, transfer. 
Fourth, the programs failed to develop or use valid, useful measures 
of skill development and the Instructional process. Without these 
forms of sensitive documentation, the programs lacked defensible 
bases for Individual diagnosis and ii»n1tor1ng, oi^ for program l^ove- 
ment and validation. Finally, the programs often failed to allow for 
enough flexibility to ac^om)date the dynamics of the contextual 
system in which they operate. 



Sunmiary 

The task of designing an Integrated instructional and assessment 
system for critical thinking poses a formidable challenge. School 
systems must decide whether they want to teach critical thinking as 
generalized or curriculum-embedded skills. Schools must also specify 
the set of component skills the critical thinking program will teach 
and test and the range of content and activities in which students 
will use critical thinking skills. The specified set of skills and 
tasks can then focus efforts to select or develop appropriate coordi- 
nated testing and instructional activities. School systems can draw 
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upon research trim the fields of leamlns* Instntctlon, ami program 
io^lesiefitatlon to select or itevelop carricula that tdll offer sufffclent 
guidance, practice and feedback to teach ti^ skills and that will be 
appropriately tailored to the systen and classroom contexts. 

A1th<Hi9h fiyrlad bodies of research can Inform the design of criti- 
cal thinking progra«s. systematic study of effective teaching strategies 
and Instructional activities Is desperately needed. Efforts such as 
the Pittsburgh HAP Critical Thinking Project are attei^tlng to use avail- 
able research to develop such an effective program. 
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tikefytot^to&ofsmaKtrm^ Wf^to^<^sirmn trials^ probability cf 
a few success^ a few accc^r^a^fisft/r^nts, goes up." 

'Schools are organize to (to k^(^&^^ but gating bemste^ 
oftenisn'tcmdUmn. T7m r^vauit princif^ of organaa^ ^ this: if 
time, ^pace, materials andpec^ s^nc^organ^ina way that per- 
mits professtona/ devefoptwnt to compete witii o^r oblations, it wiH 
ack:t up to nau0t" 

•'The re^ worki(^ classrooms will always be rwrea>rry:^x, morechal- 
ter^ng thar) we can represent on paper by ^ Mings from research. 
TheoniywaywewilldiscoverhowttmoryarHjresearchare 'practk:al' is 
to cdlaborate in presenting a sef of principles or a ^t of ideas long 
enough to get them tested, arxi while presenting ttm integrity of tt^ real 
world setting" 

■ 'Gettir^ better together ought to pay off in lar^ and small ways for stu- 
dents, teachers, ^ministrators, scfwols and communities The chal- 
lenges vve set for ourselves, the demands we place on ourselves and 
others, must be matclwd by ttw level of support ard reward we are 
prepared to offers' 
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MOVING TOWARU CmiNUOUS ^HOOl IMfROVDKNT 

Judith Warren Uttle 
A(>p1y1n9 {^search In Teacher £<lucat1ofi 
Far West laboratory for Educatltmal Research and Develop^t 



Tnere's a scene In ^ne aovie ''Butch Cassldy and the Sundance 
Kid" In which. In order to get a job (as a payrolT guard!) the 
Sundance Md Is handed a pistol and told to shoot at a coin lying SO 
feet or so down the dusty road. So l» stands there stiffly, >o1nts 
tne pistol, shoots and misses hy about three feet. The boss shrugs 
in disgust and starts to walk a«ray. while the Sundance Kid stands 
there and says, "Can I move?" The boss says, "What do you jsean?" and 
the Kid crouches (town, draws his gun, shoots rapid-fire and sends the 
coin flying. Then he stands up and says, "1 do much better when 1 
move/ Uell, I do much better when I aiove. Vm a pacer and Vm 
ratfier chained to this microphone this morning so I hope you will be 
tolerant as 1 curb my desire to pace up and down and join you In the 
audience. 

A good clossroom teacher or a good principal sometimes has to 
have the willingness to stand up and Io-jk Ifke a fool In front rf a 
lot others. I think on this rainy Thursday morning we ought to share 
that risk of making fools of ourselves and so I'm going to ask you to 
join me in something. Vm going to ask you to join ne In taking the 
notion of a "keynote" seriously. All right. Are you all awake and 
there? Let's try this together. I sing in the key of "L" and 
probably lots of you do, so don't be afraid. MMMMMMMMMmmra (audience 
hums). Very nice! Now 1 also know that as children In our society 
some of you could not escape exploiting your talents and learning 
additional skills. Some of you —and you know who you are— can sing 
in harmony. So let's try one more time with more richness and 
ful Iness. MMMMMMMMMMMMMHmmmra (audience hums in harmony). See what 
we can do together? I love it! I got that Idea for taking the 
keynote seriously from my friend and colleague Tcm Bird. The nerve 
to try It I had to drum up all by myself. I did it for three 
reasons. The first is that some achievements require the energy of 
more than one person. I wanted tof alter the situation at a 
conference like this, for example, in which the person honored with 
starting the day also assumes the full hurden of establishing the 
meanfng and momentum for that day. So ycu'vi* now shared in 
establishing some of the meaning and momentum, and that principle 
applies to all of our work. Second, we have just shown that you 
don't have to have a flawless performance to get started; rough edges 
are all right. We can go ahead and get started with small trials 
even when we're somewhat uncertain of our ground and clumsy in our 
efforts. And third, if we can't behave oddly enough to change how we 
conduct a meeting like this among ourselves, we certainly can't 
bendve oddly enough to change how we work In schools. So with that 
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prologue 1*6 Hke to state sme articles of belief that establish a 
context for «ftiat I've learned in trying to get close to the ^actlces 
of professional developstent. 

Num^ One: Tve come to be a firm believer In bl^ Ideas amf 
small tactics. In recent years, as tbe work on effective school s and 
effective teaching lias been widely pybHclzed, we've comp agatn to 
share an optlalsm abiHft what schools can accoispllsh* an optlmlso that 
iifas sadly lacking for some tisie* That (H^timlsia restores our faith 
and conflrsis our experience that the things tl«3t isake a difference to 
student learning are umter the inflttenee of p«lp^e who work In the 
schools. At the same tiuw, the business of getting better doesnt 
happen In big ways, learning In c1assro<^s happens In the ffloa^t-by- 
flionent Interactions betwem teachers and students. Similarly In 
schools. If we are to get better, It's likely to take lots of small 
trials. With lots of small trials the probability of a few 
successes, a few accomplishments, goes up. With lots of small trials 
we're also going to have failures worth celebrating. It's that 
moment -by -moment experimentation that adds up over a period of time. 
That approach will take a perspective that's a Tittle bit different 
from the one we ordinarily a^\}f. It's going to take a certain 
playfulness with our ideas, a playfulness with the idea of experitnen- 
tdtion. That runs counter to a lot of (Hir self-imposed seriousness 
about educatl^. I once came to wonder why it is that educators, 
unlike physicists, don't show much playfulness about their ideas. 
Look at the discoveries in physics and the imagery that's conveyed in 
the way that physicists label what they're finding: quarks, strange- 
ness, black holes. We don't have the same kind of high imagery In 
education, but we ought to attempt to foster It, together with a 
shared language for describing, analyzing, and unraveling the 
problems of teaching and learning. (n;hers have reminded me that 
education, second only to the ministry, holds a sacred trust— the 
education and care ot the young. Communities and parents hold us 
seriously accountable for our efforts, and the notion of being play- 
ful In that context is unusual, difficult. I would propose that in 
rooms like this, however, we can afford to be playful. And that the 
playfulness that we exhibit here will allow us to be serious in our 
efforts In, classrooms when in fact we are in contact with children. 

A second article of belief Is that getting better is driven 
irretrievably by belief, value. Initiative and nerve, and there is no 
substitute for tUose. Someone out there, some persons, some groups, 
have to have the guts to get started and faith In where they're 
headed. They have to pick something worth trying and do It even when 
they're uncertain of the outcomes. In the absence of that Initia- 
tive, all of the technical knowledge and skill that we've been 
Morking at building, all of the thoughtful organization will prove 
sterile. 

Third, there's no such thing as neutral except on a car. There 
is no neutral instance of professional development. Every occasion 
that we have of working together as professionals will either build 
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our commitment to professional growth, to a vision of teaching and 
teachers, or it will erode that commitment. There's no half way. I'm 
talking about professional vision, professional commitment. We can't 
go on assuming that we can fill inservice "slots" on the grounds that 
"Oh wel 1 , it may not help but It can't hurt." It can indeed hurt. 
Every encounter we have with one another will build our commitment 
and our investment, or it will erode them. 

What does that do to staff developers? If there are staff 
developers in the audience, you all ought to be hiding under your 
chairs at this point. What I want to Introduce as a caveat here is 
that "having no such thing as neutral" is not the same as a require- 
ment for a smooth, polished performance. In fact, we do ourselves a 
tremendous favor by letting the rough edges show, as you did this 
morning by singing out. Rough edges give us a way to hang on to each 
otner, to grab on to each other's understandings, to find a way to 
connect. The smooth polished performance leaves people saying, as it 
does in some demonstration teaching, "That was wonderful, but ^ could 
never do It." 

We have, then, a set of beliefs that add up to this: there is 
power in shared value, shared commitment. There is power in a shared 
language for carrying on with our work, for describing, analyzing and 
refining the worU of teaching together. And there's power in the 
notion that small events add up to something big. 

In the remarks that follow I'd like to work back and forth 
Detween broad principles und a set of concrete specific examples. 

With respect to broad principles I am led to try and back up 
soine claims about collaboration and collegiality. Because collegi- 
ality and collaboration form such an attractive set of images, we 
have even morti of an obligation to explore what it takes to live them 
out in practice. So let me start first with the notion of 
organization . Schools are organized to do lots of things, but 
aetting better steadily often isn't one of them. The relevant 
principle of organization is this: if time, space, materials and 
people are not organized in a way that permits professional develop- 
ment to compete with other obligations, it will add up to naught. 
It's a matter of the economics and politics of staff development. We 
must concentrate professional development in the ordinary week-to- 
week opportunities of people working with one another. Concentrating 
on now to revise the five percent of time that we have people 
captured for organized Inservice, rather than concentrating on the 
9S% (}f the time that they spend in the work day at schools, is to 
miss d tremendous opportunity. I'd like to give you several large 
dnd !indii examples of what that might mean in practice. 

At the district level, it simply means that whoever's in charge 
ot ,r.aff development ought to be simultaneously responsible for 
..imcjlum and instruction. If staff develonment as a function in a 
ji.r.ri:t IS not inteqrdlly tied to the obligations of the instruc- 
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tional program and to the rewards and obligations of teaching, 
there's ver^ little reason for anyone to take it into account. 

At the building level, there are small examples that illustrate 
how small decisions make a difference as to whether or not people 
will work together to get better. Let's try the copying machine, the 
bane of everyone's existence. A portrait of two schools: in the 
first school, with a faculty of nearly 100, there are two small 
copying machines. One is located in the teachers' lounge and the 
other is located in the main office. Each one is of a size adequate 
to serve the needs of a small, not very successful, real estate 
office. An observer can sit in the teachers' lounge and watch the 
teachers trail in during their planning period. TTiey come in with 
worksheets to copy, and they stand in line for the machine. Their 
first question is "Is it working?" Teachers have one planning period 
a day. That one periCKl a day over a week's time adds up to several 
hours of available time for professional work of all sorts. To spend 
it standing in line for a copying machine seems a tremendous waste of 
professional capital, ftow let me give you a portrait of another 
school. This is a junior high with a faculty of 50 that has a very 
large reducing and collating copier. It Is staffed by two aides who 
receive orders for copying from teachef's. Every teacher in the 
building feels adequately supported, every teacher in the building 
has the time to make use of common planning periods. Small decisions 
about money add up to big opportunities. 

Another example of the principle of organization. This has to 
dO witn the way that people cast problems and solutions. In one 
district, the teachers' union has negotiated a provision for "class 
size relief as a way to relieve the burden on teacher time." That 
means that a teacher or a group of teachers can apply for money from 
d fund to supply teacher aides, lay readers for the English depart- 
ment, that sort of thing, A teacher is expected to have compelling 
circumstances to capture some of that money. The result in that 
district is that interpersonal competition is increased, not 
decreased, and the planning burden is relieved for no more than five 
percent of the teachers. By contrast, a staffed workroom and copier 
hds the effect of relieving the planning and preparation burden of 
every teacher in the school, measurably increasing teachers' 
willingness and time to work together. 

The third example of organization; observation for fun and 
profit, There's been a lot of enthusiasm lately for getting 
principals and peers into classrooms. Help me out. Give me an 
estimate of how many times I would have to visit a classroom for you 
to trust me to make some kind of meaningful comment on your teaching 
and give some meaningful advice. How many of you think I can do it 
in one visit? How about two? We have a couple of takers for two. 
Three? Ukay, a few more. Pow about four? Okay. How many teachers 
are m the audience? Not very many. Teachers tell us they'd be 
confident in us after three or four visits. They feel even more 
confident if an observer is there several days in a row, preferably 
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dt the beginn1n9 of a unit, in order to get a sense of continuity and 
depth. 



In a high school with a faculty of 80, what would it take to do 
observation and feedback on a scale large enough to make a 
difference? If the principal alone does observation and feedback, 
and does one observation a week, U would take over two years to get 
to everybody at least once. At that kind of level, a teacher's 
experience of observation and feedback is likely to be by rumor, not 
experience. How many people would have to be involved to start to 
prt,duce observation on a meaningful scale? Three people, each 
cbserving three times a week, could get to everybody once every two 
months. On that scale, observation may start to be a meaningful 
event. The issue here Is whether there is a plausible connection 
between organizational arrangements we make for professional develop- 
ment and the professional Improvement outcomes we desire. 

The uses of discretionary time reveal something about those 
"plausible connections." As a condition of professional development 
in buildings, we talk about shared planning and preparation, the 
oppo. {.unity to talk concretely about teaching. People say, "yeah, 
but when do you do that?" Well, the answer is that if you don't do 
it in the school day, you're'not going to do it In any kind of 
meaningful way. That raises the Issue of common planning times, time 
during the school day. There are a lot of things that stand In the 
way of organizing time when people can regularly and frequently get 
together to talk about their work and to plan It. In one junior high 
it took 18 computer runs to manage a schedule in which at least 88-90 
percent of the kids got the schedule configuration that they needed. 
And all of the core academic departments also had common planning 
tiine. But because common planning was viewed as important in the 
order of priorities, people kept at it until they got It. In high 
schools where there is a tremendous proliferation of elective 
offerings it gets harder still. You can go for the aim of having 
commun planning time for subsets of people who actually have a reason 
and an interest in working together on something. Elementary schools 
pose a different problem; very often they don't have any time during 
the day. But if you set it as a priority, you'll locate 
opportunities: rearranging faculty meetings so that they deal with 
only the business of teaching; organizing grade-level meetings so 
tndt tney deal with only the business of curriculum and teaching; 
scheduling the instructional day to permit a common planning time 
before school begins. Finally, we can make systematic rather than 
Hio-iyncrdtic use of release time. In many districts, we offer 
hdncf^s tor people to pursue individual courses of professional 
ch'velopjnent. I would simply argue that if we want the uses of 
release time to add up to a difference in our schools , then we ought 
to think about asking, as part of a proposal to use release time, 
^.n^t people.be able to demonstrate how it's going to contribute to 
the work of this place as well as to the work of this person. That 
wnnrever pos'iible we use di strict -funded release time for groups or 
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teams, not Individuals, and that we find a way to get Individual 
credit attached to group efforts. 

Now let's turn to matters of knowledge and skill. In staff 
development, we know a lot about the design of good skills training. 
We don't always have the time or energy or staff or materials to do 
the job we know how to do. There's some slippage. And the outcomes 
we're after do not always lend themselves well to skills training. 
But when such skills training is appropriate, we know something about 
how to design It: we know tc make outcomes clear, to model the 
recommended practices as trainees, to demonstrate them as they would 
be used In classrooms, to provide supplemental materials, and to 
organize opportunities for practice, discussion and problem-sol ving. 

What happens to staff developers who try to do that day by day? 
Here are some of the practical problems that seem to arise for people 
when they struggle to make the best use of what they know. One of 
the problems is that it is very hard to model fully in training the 
range of Instructional practices that you want people to use. Class- 
room management Is a qoo6 example. If I am to model fully a set of 
proactive classroom management strategies throughout a training 
session with adults, I have to be prepared to treat a room full of 
adults as if they were eighth graders. Now I don't mean "talking 
down" to them. I do mean taking every opportunity to model 
strategies for keeping everyone engaged; That may mean calling 
dttention to strategies for getting participants out from behind 
newspapers, or for redirecting side conversations, or for insuring 
full participation in groups. It's very hard to do because It 
violates norms for what "Inservlce" is like. 

A second problem that people face in doing adequate skills 
training is getting materials, examples and exercises that fully 
capture the range of Instructional circumstances represented in the 
room: all of the grade levels, the subject areas, the levels of 
ability. This underscores the fact that staff developers cannot do 
the job alone, and it underscores the trap that we find ourselves In 
when we try and establish credibility with teachers. Staff 
developers feel this tremendous obligation to establish themselves as 
knowledgeable, to convey the impression that they have "been there," 
Une of the ways to convey the impression that you have "been there" 
is to have enough examples from different classes and different 
levels and different kinds of schools, to give the texture of school - 
life in your presentations. That is credibility based on 
t uni I larity: "I understand," A second, and more powerful basis for 
iredibility arises out of a thorough analysis of particular problems 
m curriculum and instruction. The latter is built on an in-depth 
shared knowledge of the relevant currlcular or instructional issues, 
shared involvement in work that extends beyond skills training to 
a conceptual grasp of key problems and principles. And no staff 
dt'velopmunt office will ever be able to do that alone, thus bringing 
us to the principle of collaboration. 
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Col labordtion Is a wonderful Image. It says to people, "We're 
interested In you. Ue think that you're doing something worthwhile, 
worth looking at, worth learning from, worth joining in.** Viewed in 
one way, collaboration is a form of politeness and consideration to 
people. To speak of collaboration is to convey your intent to do 
good instead of harm to those with whom you work, and to treat all 
partners as knowledgeable contributors to a joint venture. 

I would like to make the claim here, however, that collaboration 
must be something more. No matter how definitive, how solid our 
technical knowledge becomes, how much faith we have in the findings 
on effective teaching, those findings will always be inadequate to 
account for all of the occasions in which they are applied. The real 
world of classrooms will always be more complex, more challenging 
than we can represent on paper by the findings from research. The 
only way we will discover how theory and research are "practical" is 
to collaborate In preserving a set of principles or a set of ideas 
long enough to get them tested, and while preserving the Integrity of 
the real world setting. Simple etiquette, while important, will not 
take us far enough; in fact. It may lead us to compromise 
prematurely. If we can separate the language of practices and 
consequences , the tools of our trade, from people and their 
competence ws may manage to develop thick enough skin to work 
together in enough detail, with enough persistence, enough humor and 
enough tolerance to struggle through to application. 

The principle is this: successful professional development will 
require a set of social relations among us all as colleagues, 
characterized by reciprocity and respect. These are relations summed 
lip by teachers as trust. Think a minute about what you mean by 
trust. When I say I trust people, what I usually mean is 1 have 
known them long enough that I trust them to do well by me. I trust 
them not to harm me. If they do harm me I trust whem not to have 
Intended it, and I trust them to work with me to repair or restore 
the relationship. In our work with one another, we have the 
challenge of finding a substitute for trust based in long-term 
intimacy. 

Let me just share with you a few of the ways that colleagues 
establish trust. They share obligations and risks, I'll use an 
example based on observation. Teachers trust observers when it is 
eminently clear to the teacher that the observer is working as hard 
to do a good job at observing as the teacher is working to do a good 
job at teaching. As an observer, I have the obligation to capture 
that class for the teacher, to be eyes and ears for that teacher. If 
I fall down on that obligation, I expect to hear about it. We share 
in the obligations to do good work, each from our respective position 
as teacher or observer. We also share in the risk. For example. It 
Ought to be clear to the teacher that the observer is open to 
instruction too. So, every time we talk about your teaching we also 
tdl« about my observing. It's a shared participation In the risks, 
in the Obligations and in preserving high standards of professional 
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work. Th« second aspect of trust Is opportunity for Influence. If 
we are full profesvlonil partners In this then we both ought to have 
a say in what we are ItMiklng at» how we are looking at It, how long 
we 1<x}k at It, what kinds of discussion we have later, wnat the 
consequences are* A third aspect of trust is the predictability of 
criteria and procedures. In the absence of certainty about what's 
"right" and In situations where it's easy Inadvertently to hurt one 
another's feelings. It helps to be able to fall back on certain 
agreements that are firm. That gives us a way to talk about our 
difficulties and errors. A final contributor to trust is separating 
the language of practice from the language of people, and 
concentrating on the former* 

And now we turn to matters of leadership. The central 
challenge, or principle, revolves around the shaping of meaning, 
values and belief. l>ie practical problem is maintaining a visible 
order of priorities amid the press of competing obligations and 
demands. Successful leaders (including successful classroom 
teachers) appear to live by four rules of thumb. The first rule is, 
"If you want it "Whatever it is— say so." Make the values public and 
specific; the "Irapllcif goals cannot begin to compete with those 
explicit obligations that place demands on people's energy and time. 
A second rule of thumb is, "If you want it, teach it." Itescribe it, 
train for it, model it in practice, show it in day-by-day and moment - 
by -moment interactions with one another. If we want to hold out a 
vision of a collegia! and rigorous profession, then our daily Inter- 
actions with one another must have that character. A third rule of 
thumb Is, "If you want it, organize for it." In the absence of 
opportunity and organization, public declarations are meaningless. 
It Is fruitless, for example, to tout the virtues of collegiality in 
schools If we are unwilling to carve out common planning times for 
tedcher*> during the school day, every day. There will be trade-offs 
with respect to money, materials, people, time and space, and the 
choices that are made will reflect the "real" order of priorities. 
Hnally, the fourth rule of thumb is, "If you want it, reward it." 
Uetting better together ought to pay off in large and small ways for 
students, teachers, administrators, schools and communities. The 
challenges we set for ourselves, the demands we place on ourselves 
and others, must be matched by the level of support and reward we are 
prepared to offer. And on that note I'll let you get coffee. 
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"Here is my three-point summary of where we stand today One, the 
public is demanding more than ever before and receiving more. Two. 
they are giving us less money toctoit with. Three, they are criticizirrg us 
more for it. But my impression as I move arourKi is that a lot of us are 
more burned up then txjrned out about the sipjatbn" 



'The only way that we as educators are going to meet the present 
demands fs to become more efficient. This is not a wo/cf we ///re. We 
tend to shy away from it. But the inescapable fact is that we are going to 
have to get more results from the resource ' that we have." 

The local school workplace needs to become a growing, renewing, 
'oarmng, problem-solving environment for everybody in it — not just for 
me kids, but also for the teachers and the principals as well." 

Schools have either an energizing environment, a maintenance-orient- 
ed en\/tronmer)t or a depressant environment. The aim is to move to an 
energized environment if you do not already have one." 
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EFFECTIVE STAFF DEVELOPMENT 



Robert N. Bush 
Center for Educational Research at 
Stanford* University 
Stanford, CA 9430*} 



Considering the long time that 1 have been at this business, you 
would think I would have probably said it all by now. But, let me 
assure you that I have recently been engaged In some work that I have 
not talked about or written about before, and 1 am delighted to have 
the opportunity to share it with you. 

My topic today Is effective staff development. It translates 
Into this question: How can we— teachers, educators, administra- 
tors—continue to Improve CHjr skills and to grow as professionals 
throughout our careers? I submit that this is one of the most vital 
questions facing American education today. And If we can find some 
successful answers to it, it seems to me that It will go a long way 
toward helping tc solve the problems both of quantity and quality in 
our schools and in supplying educational personnel to staff them. 

Before I get to the heart of the research, I want to blow off a 
little steam regarding the predicament In schools today. Are we in a 
crisis? Are the schools a disaster area? Have they and do they put 
the nation at risk as has been so prominently discussed in current 
reports? Are we about to be overtaken by the Japanese? I remember 
25 years ago It was the Russians, and 20 years before that the 
Europeans. I wish I had time to sketch so;..e historical background of 
where we have come with our school system since we brought it over 
from Europe and transformed It Into an indigenous institution because 
I think there are some very Important lessons as we consider what we 
are doing now. I am an historian and I like to do that, but that was 
not what I was Invited to do. Ask me again sometime and I will. 

Is the nation at risk? If the question is, "Is the nation at 
risk because our schools have done such a bad job?", the answer Is a 
resounding "no!" If on the other hand the question Is, "Is the 
nation at risk If we do not support and substantially Invest more 
resources to make the schools as good as we can?", then the answer is 
a resounding "yes"! 

Bud Hodgkinson, writing last year In PDK, points out that the 
schools in the U.S. are good and getting better. They are critical 
to the future of the country and the public Is increasingly under- 
standing that fact. And he points to the fact that It is a relief 
that after a decade of psychic recession or cynicism about many of 
Our public Institutions things are beginning to change. He says that 
tne U.b. public education system Is a remarkably successful 
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Institution. 1 concur. It Is designed for every student and yet Its 
very best students are as good as those of any in the world. It 
provides a high return on the dollars Invested. And the future of 
America depends .on investment in the development of human resources. 
Schools are obviously the best place to invest this resource and 
obtain the highest returns on that Investment. 

Here is my three -|>oint summary of where we stand today. Une, 
the public is demanding more than ever before and receiving more. 
Two, they are giving us less money to do it with. Three, they are 
criticizing us more for it. Demanding more, getting more, giving us 
less to do it with, and criticizing us more is a pretty "rum" 
situation. I think that an impartial judge from another planet would 
say that it is really not quite fair. And so as an educator, I think 
I share with a lot of you that sometimes we are a little angry, 
sometimes we are a little frustrated, sometimes we get a little mad. 
Maybe we get a little defensive. If so, I think it is not altogether 
unjustified. But my impression as I move around is that a lot of us 
are more burned u£ than burned out^ about the situation. 

The public is demanding more and is going to continue to demand 
more. This will not change. The list of what they are demanding is 
long. And the key word is more --both in amount and in kinds. They 
want education from pre-school to community college; they want it 
close to home; and they want it cheap or free. They want each of 
their children taught according to their philosophy. They want the 
children to study the kinds of books wnose points of view they agree 
with. They want the schools to fix each new problem: drugs, safety, 
sex equity, energy, metrics, morals, minorities, handicaps, etc. The 
list is long. In our recent research we found 58 different things 
thdt the federal government or the state government wants fixed. And 
dt the same time we are supposed to spend more time on the basics. 
The public wants higher achievement, but they are not satisfied just 
to have students go 'through the schools. They want to give an 
independent test to be sure they have learned the material. And if 
they have not learned it, the questionable assumption is that it is 
the school's and the teacher's fault. The public wants every child 
treated individually but it wants them all to ba treated equally. 
The handicapped children are to be mainstreamed and no discrimination 
of any group is permitted either overtly or covertly. And on top of 
all of these demands is the one that we must educate students in a 
way that is entertaining and immediately relevant. 

Why these increased demands? There are at least three reasons, 
hirst, we have a long history of higher and higher expectations in 
this country of all of our institutions but particularly of our 
schools. And partly because of these higher and higher expectations 
we have been getting more and more. Secondly, we have a much better 
educated public. They are more literate, better organized, more 
^',tive, and they have a better knowledge of what is going on In other 
parts of the world. They see on T,V. one week what is happening in a 
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Pennsylvdnid school and If It looks good they want it In their 
scnools In California or Nevada. We are victims of our own success. 
And thirdly, there have been a series of societal changes of profound 
character. We have moved from a muscle to a machine to a knowledge 
society. We are moving frwn a monistic, scientific society to a 
pluralistic and humanistic one. AU of these cause many problems and 
demands. 

The demands will shift, but they will continue. We cannot 
expect them to decrease because the public schools and the private 
schools were formed in this country to meet the social demands of the 
country, and we will need to continue to try to meet them. Thus, we 
are caught In a cruel bind. We need more and better education than 
ever before both for the Individual and society. But the resources 
are limited for a variety of reasons— not the least of which Is there 
are other social demands as well. In a situation when higher 
expectations are not met, dissatisfactions are bound to arise even 
though things may be getting better. The only way that we as 
educators are going to meet the present demands is to become more 
efficient. This is not a word we like. We tend to shy away from it. 
But the inescapable fact is that we are going to have to get more 
results from the resources that we have. 

Now let me turn to the heart of what I want to say to you, my 
topic of effective staff development. We have been working in 
Cdlifornia on a five-year longitudinal study of staff development In 
schools that began in 1979 and finished in 1983. Our sample Includes 
seven counties, twenty school districts, and about 80 schools. The 
study was undertaken at the request of Dr. Alex Law, the Director of 
the Office of Program Evaluation and Research in the California State 
Uepartment of Education, as the result of what the legislators, the 
public, and the many of his staff were saying about these current 
staff development programs. There were complaints that they were not 
working and that teachers did not like them. They called several of 
us together to ask if we could evaluate staff development, find out 
rthdt rtds going right and what was going wrong. We began by looking 
at two tnings. First we studied all of the initiatives from state 
and federdl sources and found that nobody in the State Department 
<new dll of them or how they were related to one another. Once we 
sorted them out, wp went to the schools to talk with the teachers, 
principals, superintendents, and students as to what was happening 
wnen those initiatives came down. And we found that it was not what 
«»d5 intended by those who handed them down. 

Another conclusion was that in order to determine how staff 
(I^v-pI opment is operating and how it can be made to operate more 

f r. 1 ^ply, we needed to take an in-depth approach. We proposed a 
tnree-to-f 1 ve year study that would examine particular schools in- 
Inptn fiDd tdU with people over a period of time. We sent in our 
rf'port and thought we would hear no more. It wds only 2U pages, but 
iL Mss a rather hard hitting report. To our surprise they said, "It 
'•,'>»in.js reasonable. Will you design and develop the instruments for 



Such i study?' Me worked for a year with teachers and administrators 
and designed such a study with instrumentation. This time the report 
was 250 pages long. It said "If you want to conduct an effective 
study of staff development, here is the way to do it." Again to our 
surprise they said. "O.K., will you undertake a three-five year study 
and try to put these ideas into operation?" That is what we have 
been doing the last three years. Ue have made five reports, one for 
each year of the study. These are the data I am drawing upon as I 
speak to you today. 

« 

To optimize staff we first need to have well -trained teachers to 
begin with. Second, the local school workplace needs to become a 
growing, renewing, learning, problem-sol ving environment for every- 
body in it— not just for the kids, but also for the teachers and the 
principals as well. We find that they are not that way now. Some of 
them are and some educators do continue to improve themselves 
tnroughout their careers. However, it is unfortunately not the rule. 
Schools by and large are not self-renewing organizations. Too many 
of them are "tired." And the reason they are tired, I think, is 
because we are spending 99% of our time running the schools and not 
enough time observing what we are doing and taking time to think and 
to plan how we can Improve. What I want to talk about is how we can 
change the character of the school workplace so that it becomes a 
self -renewing situation. 

I want to concentrate on four things. Figure 1, with the little 
circles on it, will serve as an organizer of our thinking. I will 
cover numbers VI, I, III, Training, Orientations, and Initiatives; 
also number V, Teachers and number II, school environments. If I 
have any time left. I w1 11 talk a little bit about number IV, leader- 
snip, to add a few things to what Dr. Bossert covered earlier on this 
topi c. 

Let me start with training. We suggest five levels of 
training: (1) presentation of a theoretical and conceptual base; (2) 
modeling; (3) practice In controlled situations; (4) feedback; and 
(5) assistance and application. The objectives of training are 
conceptual control, skill and use. Let us suppose that one hundred 
of you went through the best possible presentation of the theoretical 
and conceptual base for a new procedure or something that you wanted 
to put into your In-service program. How many of you would go home 
and use it? We find from our experience and research results that 
about 10% would use It. Now suppose that it was also well modeled. 
It was demonstrated for you. You could see It done, either live or 
on videotape. How many do you think would use It? It Increases it by 
dDout ?%-3%. Now suppose you have a chance to practice It, not in 
your regular classroom but In a controlled situation with a few 
students or with some of your colleagues. How many woulu go home and 
use It? It turns out to be only about another 2% to 3%. What 
happens if you get feedback on how well you have done it? Again only 
anotn^r 2 or 3%, But if you go to step 5 and somebody helps you in 
yj'j'- class and in your school to adapt this, it goes up to about 9S%! 
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III. INITIATIVES 



Oriented ^ 



A. Tficrgized 



1. Str^ict-S tf ltddvd 
Within the ScMiOl 

2. Services to Schools 

r C'Cuv t'd on Cuf M c ulum 
and Irbtruction 

3. Services to Schools 

f.^f G?'. ^f.'. r^:! rt) 

4 Services to Iniivi- 
djaU for Inservice 



Services to I'.divr 
duals for Role ^ 
P rep drat i on 




• Principal as t'dnaq^r 

m Principal as Hdrronirer 

• Principal f'otivdtur 



(.kO/.lH STAUS or TEACHL'RS 



• Onini vore^s 

• Active CofiSUHiers 

• Passive Cofi%umers 

• Rttr£fftfied 

• WitKJrav.n 



' ' 1 ' i nr 



(SLfitr'^t ic pu ;ufed !>» Kurgan Ddle t^t f t /'c:f c^ » 19B3) 



t. Services tmbedded Viihtn the Schoo) 

2. Service to Schools Focused on 
Currlcul*^ and Instruction 

3. Services to Schools for Organi- 
sational Development 



4, Services to Individuals for 
Inservice Developfient 

5. Services to Individuals for Role 
PrCf iif fltion (Pre-service) 



lxaftg)les 

Informal social si^port system (teacher- to- 
teacher, resource specialist). 

Clinical Supervision (teacher- to- teacher or 
Mith involvesent of principal or consultaotK 

Consultants working to ifnprove problem- 
solving/decision-making quality of the 
school environment. 

Training courses and workshops to indivi- 
duals for role development. 

Cr*--lit-hearing instruction to individuals 
for role preparation (credentials or (tegrees) 



$.i n: S CHOOL environments 

|r A. Energized 



8. Maintenance Oriented 



C. Depressed 



Staff feel njotivated to work on professional 

developncnt and program improveroent* , . 

Energy tends to be expended in maintaining 
program {little left for iniprovement and 
change). 

Environment seems to sap energy from people. 



in> INITI ATIVES 

a. School Based 
fc. Agency Credting 

L. Special ropuldtions 
d- Curriculurr Irr,;.ro ^enent 

^!andN^er 

Har; .of^ ^ zer 



AB 551 (Staff Development) AS 65 (SIP) 

Teacher Centers, Resource Centers, County 

Offices 

Special Ed, Voc. Ed, Gifted a Talented 

Bay Area Writing Project, California Kath 
Project. 



Critical work activities (CWA) tend to be 
budgets, operational matters. 

CWA emphasize conflict resolution, problem- 
sol ving. 

CWA put rnphasis on long-range planning, 
staff development, program imprcvt^iuent , change 
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ERIC 



Seek Out or create opportunity for grc*^th. 

lAo ^oue initiative in stuff dt velo^/n.^-nt. 

Will pdrticipate but dependent cn others. 

5u-pKious of innovotion, resist change, use 
if.forc.il Sjst<-ri tO control and Mifle. 

ru*'.h dAay dttivity options in fornial '.ystenr, 
rarely use informal interacli on, 



W. TRAINING 



A. 



Levels 



1. Presentation of Theoretical and 



Conceptual Base 

2. Jtodeling 

3. Practice in Controlled Situations 
(f«1croteach1ng) 

4. Feedback 

5. On-hands Assistance in Application in 
Regular SchooVClassroom Setting (Coaching) 



B. Objectives 



1. Conceptual Control 

2. 'Skin 

3. use (Transfer) 
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Unfortunately, most staff development Is at level one and two. 
Sofoettwes U gets down to three not often to four or five. But you 
need to reach number five If you want a substantial number of people 
to use the training. 

let me now turn to some a^itl^l data from the Study. In 
California there Is no well -established, smoothly flowing staff 
development system In place In most school systems. Me are spending 
substantial and growing amounts of time and effort In staff develop- 
ment, school Improvement, and In-service education, but they are not 
yet having a noticeable Impact in most places. These matters are 
still considered to be smnethlng done to a teacher by somebodiy else. 
It Is done to, not by, for, and with teacher. Further, the treatments 
are weak ones, even though powerful ones are available as the result 
of a decacte of research and development. The»e stronger treatments 
do not for the most part reach our classr^ms and affect the learner. 
Nonetheless, I am not pessimistic because we are finding that things 
are beginning to move In some places. We have found local schools 
and local school districts where energized envl r(»)ments have been 
created, where a grcmp dynamic Is present and a local problem -solving 
orientation to school Improvement Is operating with accelerating 
force, where there Is a genuinely collaborative effort In place and 
all parties Involved are working together to make that place better. 
Is it possible that the number of these places can become more wide- 
spread so that this will be the rule rather than the exception? My 
ansMer is unequivocally yes. It can be. So much for training. 

Now let me tufn to the next item in that list— teachers. We 
find in our studies that teachers are not all of the same cast. Me 
have developed a five-fold category. At the top we have what we call 
the "Omnivores"; they consume everything in sight. (Remember we are 
thinking about staff development.) We have the "Active Consumers." 
They will actively consume what you give them. They will not insist 
that you give It to them, but they will consume it when It is given. 
Then we have "Passive Consumers". They will not look for it. They do 
not show a great appetite for it, but they will eat it. Then we have 
the -yithdrawn," and finally the "Entrenched," who have their feet 
firmly set. Now think of your school, or your situation. What 
percentage do you estimate are in those different categories? Now I 
will give you some figures so you can compare your estimates. We 
astced principals to estimate what percentage of their faculties they 
thought were in those categories. The principals said 29% of their 
teachers were Omnivores, 25X were Active Consumers, 30% were Passive 
Consumers, 10% were Withdrawn and 6% were Entrenched. 

Here are the figures based on what we found in our case studies. 
He found 5% Omnivores, 20% Active Consumers, 50% Passive Consumers, 
iu% Withdrawn, and 15% Entrenched. Schools vary in the proportion of 
edcn. The balance that you have in your school affects what you can 
do Nith staff development in a sigrlf leant way. That balance sets 
tne tone of the school. Frequently, as staff development programi 
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are proposed, there is a tendency to think that teachers are all 
alike; we want them all to eat the same. Alas, they are not going 
to. Another question we lave to raise is how malleable are these 
categories? Our present hypothesis is that the Omnivores and the 
Entrenched are probably the least malleable. Nonetheless, the 
Entrenched are Important to deal with because a few Entrenched people 
In a school that does not have a strong staff development environment 
can effectively block staff development. They are the experienced 
people who for one reason or another say "no," and when they say no. 
If there Is not a strong environment to the contrary, they can pre- 
vent much from going on. They can kill Innovation. The Passive 
Consumers are probably the most malleable. Here Is the largest 
number and the biggest area for action. These are some of the 
essential realities that we need to work against. Most staff 
development now offered is voluntary. We offer It and teachers are 
free to take It or to leave It. This draws mostly on category 1 and 
category 2. and they come back to the table time after time. So we 
touch the five percent and the twenty percent and miss 75% by our 
voluntary programs. 

Tnis is an important policy issue for a school, for a district 
and for the state. How much shall be required and how much shall be 
voluntary? Another big policy and strategic question is how to reach 
the 75X that are not reached by the traditional programs as now set 
forth? 

What about the amount of training that we provide? Our facts 
sho»< that overall it is very little, and even less that has the 
"hands on" part included. We found the average days of staff 
development for teachers to be 3.82. It ranged from none up to 9 or 
10; m no instance did it go beyond that. For principals, the 
average was 7.6. They are doing twice as much as the teachers, but 
neither one of them is doing very much when it comes to what you need 
to do in order to get new practices developed and translated into 
action in the schools. 

Here are a few added facts. Teachers say that they get the most 
and best help on their curriculum and teaching problems from other 
teachers, most of this being done informally. But we also find that 
teachers do not frequently visit each other's classes, make records 
of what they see, and taU about it to each other systematically. We 
find that teachers on the average spend only one or two days per year 
engaging in that activity. Why does this appalling condition exist 
in our schools? We find three reasons. First, teachers feel 
uncomfortable. We have not been socialized to do this. Part of this 
r*^S'jits from the way we train teachers, but more importantl> it is 
no* «p treat beginning teachers during the first few years of their 
profession when they are being socialized. This can be changed. I 
tT.n* u IS important for you to think about how it can be changed in 
i')<jr s 1 tudt 1 on. 
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The second reason they do not observe and visit each other IS 
that there Is no tine for It. Teachers have very Mttte free time 
Mith iiaid substitutes. This Is changing, but slowly, for It takes a 
change In attitude on the f»art of prlncl^ls, teachers, and i>arents. 
What happens when you have a substitute and go so(8ewhere else? The 
teacher says* "I cawM^ leave th^ k1ds« Think what will 
hap^n to them without mtV And the parents say, "2 do not want the 
regular teacher awasy from the classroom." And the research says, 
**You have to have more on -task tlflie.'' I am suggesting we need t^ re- 
think how we spend our tine. It might be better to alter some of our 
existing tehavlor and att1tu<tes If we are going to achieve Increased 
power In staff development. 

The third reasm that classroom visits are not more regular 
amongst teachers Is that they have traditionally been reserved for 
rating, tenure and for people In trouble. They are d<me by adminis- 
trators for those purposes rather than for the Improvement of 
instruction. All of these feelings are deeply Ingrained, tHit they 
can be changed. If they are not, the Individual teacher falls to get 
a perspective of what he or she Is doing and does not come to 
appreciate some of the things that are done well and will not be 
disposed then to share those excellent things with other teachers. 
There Is a tradition against that. But when these conditions begin 
to break down, things begin to change rather rapidly. 

Since time Is running out, let me turn to the last two points-- 
the environment and leadership. Schools have either an energizing 
environment, a maintenance -oriented environment or a depressant 
environment. The aim Is to move to an energized environment If you 
do not already have one. Hom many schools do you think are 
energized, how many are maintenance -oriented and how many are 
depressant? Again write down your estimates on Figure 1. CHir data 
are not as firn here because we are Just beginning to get this 
material together. Itere our tentative figures for the California 
schools that Me have been working with. About 10% of them are 
energized. This Is about the same as the percentage of people who 
will go away from this meeting and apply what we say, the Omnlvores. 
About 75% are maintenance -oriented and about 15% are depressant. 
These latter say, "There Is so much energy needed to keep the place 
together that there is not really much time left to be spent in 
improvement." 

Now just a word about leadership. Middle management may be the 
most crucial management in the schools. Sorry, Mr. Superintendent. 
We find three types of roles being performed: the Manager, the 
Harmonizer, and the Motivator, The Manager functions (!) to operate 
the school according to the established policies of the district, 
seeing that those policies are communicated and translated into 
action, and {2) to take care of the million details that have to be 
tdicen care of if a school is not going to run amuck and is to operate 
d t all. 



238 



Secondly, the principal is expected to make everybodly happy 
about the operation of the school— the teachers, the kids, the 
parents. This Is the harwonlzing role. And then on top of this, the 
principal is suppose to Improve the school all of the time— which 
means upsetting the equilibrium just when it has been re-established. 
Everybody is atfmoflishing you, the principal, to take on the number 
three role— the Motivator. But a look at our figures shows that most 
principals spend most of their time in number one, managing. The 
next largest amount of time is devoted to number two. The least 
amount is number three, (^r personal experience is that this has 
been true for forty or fifty years. That is as far back as I go 
personally, but the historical literature says it was true before 
that. Now, the Interesting question is why? I am sorry that I do 
not have the time to go into it, except to assure you that It is not 
because the principal is stubborn, does not want to or is not very 
bright. There are gomt strong historical reasons as to wl\y this 
condition Is true. It is the nature of the middle management task to 
perform the managerial things or the school does not keep running. 
It Is the result of the |M>licies of the school district, the 
expectations of the people frm the board of CKhJcation and the 
central office. It Is because of the rewards and the necessities. 
When this function Is performed, there is not much time left over. 
What can be done about this? I wish we could have a discussion of 
that. Unfortunately I am afraid that most of what we have been 
saying In terms of staff development leadership for principals Is 
really not very realistic. 

Tdble 1 lists five alternatives for action. At the moment. It 
looks to us as though number four and number five have better chances 
than the others for seeing that the motivational role is more 
adequately taken care of. Ue have talked a lot about giving 
teachers help, and I think that Is important because they too are 
spending most of their time doing numbers one and two. But 
principals need help also. 

Let me conclude by summing up the question of how can we 
continue to Improve and grow In our career? I would say that 
attracting an able cadre of personnel for the profession is going 
to depend upon our answer to this question. If we attract able 
personnel to teaching, train them well Initially, have an effective 
staff development program, and add adequate economic reward and high 
public esteem, then 1 think we will be well on our way. 

We must continue to build upon our knowledge base but we are not 
using the existing knowledge base nearly to the extent that It can be 
used. We need to continue to improve that base because it is far 
from where it should be. He need also to develop a master plan at 
the state level for in-service and pre-service education. We need a 
master plan as no one group or person can do It alone. The federal 
government has to participate. The state government has a crucial 
role as does the legislature and the local district and the school. 
Failure at any point in that chain can prevent other parts from 
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operating. !t Is a system. We need to work at all levels. But the 
most fundamental action Is at the local school where the teacher, the 
principal, the parents, and the kids are working. That's the roost 
fundamental place to begin. 

Table 2 lists eleven fK*act1cal qt^tlons that you can ask your- 
selves in your own local schools to determine where you are, and 
where you might most want to begin work, let me just close with 
mentioning one of them as an example— all of them are Important to me 
and you can no doubt formulate your own better list. Is there t1m4 
In the regular schedule of the school when teachers are free from 
direct Instruction of students for them to engage In activities 
designed to Improve their teaching? Is there time when they can 
visit, record the results and talk about them? Are funds available 
for teachers to do this frequently and on regular time rather than 
having it done at their own expense, after school, weekends, or 
vacations— on what I call "tired time?** 

I think the time is ripe for Important change. Ue are ready to 
move. I think there is an impetus I would agree with the governor 
that there is no need to .be defensive. We have much work to do. We 
can begin tomorrow. We do not have to wait for the legl suture. We 
need some more money which will help. But we can begin tomorrow. 
Indeed I am sure most of us have already begun. It is a matter of 
taking the next step that would be best for all of us. 
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TABLE I 



CALIFORNIA STAFF OEVELOPHENT STUDY 

Five Alternative Strategies for Strengthening the 
EducatfonaV Leadership of Principals 



1. Alter substantially the Initial training, selection, and the 
inservlce education of school principals. 

2. Change the requirements for the principal to have them all 
provide direct services (staff development, training, 
supervision) to teachers m a regular basis. 

3. Work to obtain added specialized staff who are assigned to the 
school or can be brought In perli^ically to pro»1de direct 
services (e.g., specialists In specific fields as: psychology, 
evaluation, special education, bilingual, 1 mini grant, curriculum- 
saturate the school with categorical dollars and people). 

4. Have the principal take an active role in creating a school 
Improvement; problem -solving environment in the school. 

5. Work at changing central administration and board policies which 
give greater prominence to educational leadership 
responsibilities. Augment substantially district school 
improvement policies and budgets. 



For each of these we present a brief discussion of the (1) line o f 
argument advancefl by those who advocate the various strategies, fl) 
the actions necessary to carry out the strategies, and (3) the likely 
outcomes of following them. 
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TABLE 2 



li}uttr«ti«« imttMf • $c»ot/Ciwiiiiimit8 Cm ttk 
to «to^ I It Staff taMtpmNit ^r^rwn 



t. IstlimUttetBtterettiltf dkiityMdweesayictediileQrtliead^ 
v&ea t&e tetc^s are free fnm direct ki^umk» of smdeois for tbea u> 
ei^ise is eeiivit^ ^^gittd to ia^we tlie^ teuHiiis? 

01 

Is tiiere no sueh time and do tetd»rs. idmiaistritors md pvents resist 
any efTorts mat take te^Hers avay from tiieir students for any reason? 

2. Do teadiers vmi, observe otter teadiers (in t!i^ own and otHer scHools) 
systemattcaUy. make reoords of such, and ef^age in active dialog with 
other teachers about the results? 

OS 

Do they operate aostly aS<me. behind high walls and closed doors in 
their classroom casttes? 

3 Do teachers weloome <Hhers into their rooms for observation and 
discussion of curriculum, instructK>n and are they willing to engage in 
demonstrations of things they can do well for other teachers? 

01 

Do they hide behind false modesty, traditionai taboos, and keep their 
classroom secrets to themselves? 



4 Are funds available for teachers to attend workshops, training sessions 
on topics of interest and importance to them frequently and on regualr 
Khool lime? 

OS 

Do they have to ^ these things mainly on their own time and ii their 
own espense. after school, weekends, vacations or on TIRED TIME? 



4. 1 Aad vhan ttey do attend su^ sessioas. is fi^ovui^ issistaaoe. 
lumds-ott" Mp porvided to oa^te them to adept, traaafet and integrate 
the new ideas iato their regular teadiii^ practice? 

OR 

Does the new idea, after its iaitial stimulatiaa, die aboraiag aad fail to 
get iato regidtf use ia the dassroom? 

5 Do iM^aici^ spMid a suhstaatial amouat of their tiaie taikmg to «id 
wof kiag with tead^rs. visitii^ Utw dmtNMns. helpii^ them to obtaia 
materials aad fMiiitatiag tteir ^orts at improveflwat ta a mm-treateaii^. 
aoa-evaluative way? 

OB 

Do they spend most of their time on routines of managerial details and 
public relations matters? 

6 Is the sdiool weU supplied with teachers' aides and other types of 
instructional assistants? 

Is the teacher teft alone to handle ail of the routines of teaching? 

7 Is the typical picture in a school one in which many parents and other 
citizens frequent the school and participate actively in school activities? 

OB 

Are parents and ethers called to school manity when there is trouble 
and on special days or evenings onoe or twice a year? 

8 Do teachers, administrators, parents and other citizens have frequent 
opportunity to discuss in a free and mm- adversarial manner not only the 
educati<m of particular children but matters of curriculum and instruction 
and other vital school matters? 

OB 

Is this type of dialog limited or almost non-existent or confined to when 
there is a big problem? 



243 



9. Is there i regular budget of hird tool dollars devoted to stall 
developfltefit, inaervioe educatliA and sdiool iiBjwove&ettt that is goverMd 
at the ^nm rotAs level? 

flt 

Are stKA ^orts ttaiiOy supftorted by soft, estemal ddtesfroa state 
afid federal, private souroes and si^ under suict adiaifitstrative eratrol? 



10. Does the local 9ehool,dtstrtoa&d board of edittatioii have a vritten. 
for aally adopted pdicy lith regard to iM developoent* tns^v^ 
educaticm, and sc^mI ifflproveffient behind which it has regular bu<^t 
funds that are not the first to be swept away when there is some financial 
pinch? 

01 

Is the answer to this question "no"? 
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' 'Our basic staffir^ polk^ is to recruit the best peof^ that wecan find 
and fXJt them irm reai jobs where they have a chance to make an 
immediate contritxjtion:* 



'We di^overed that h^r quality actually costs tess. Orw division 
estimated that if it did everything rig^t the first time, andontime, itcouid 
get by with one-third fewer peof^e, one-f(xjrth less space, arKi two-thirds 
less inventory:' 



MAflAti£n£l«T KV£LUPME(<T AT »€ULETT -PACKARD 



Winian P. Hllsscm 
Manager, Corporate Training and Development 
Hewlett-Packard Conpany * 



I am delighted to tiave this opportunitjf to be a part of this 
Conference for California educators and share with you the approach 
we take In developing our managers at Hewlett-Packard. In addition I 
would like to outline sofae things we are doing at HP to enhance our 
overall, organizational effectiveness. 

As a framework for my remarks, I would like to give ^miu a few 
fdcts aoout our company. Hewlett-Packard produces ccmputerc, elec- 
tronic Instruments and systems, medical instrumentation, analytical 
instruments, and specialized electronic cwnponents. (^*ders this year 
win approximate $5 billion aruS worldwide employment is about 72,000. 
We have about 60 pr(»iuct divisions organized into 5 product groups 
with factories tn the United States, Europe; Asia, and Latin America. 

Management development at HP starts with an emf^asls on our 
overall working environment. Starting with some basic Ideas of our 
founders. Bill Hewlett and Dave Packard, on how a company should be 
managed, a very unique company culture has evolved at HP. This 
culture, referred to throughot^t the company as "The HP Way", con- 
tinues to flourish* New employees learn about the HP Way soon after 
joining the company through lor^lly conducted new employee orienta- 
tion programs. The company's basic values, our statement of 
Corporate Objectives, are described to each employee (Table 1). They 
are yiven a booklet outlining the objectives In detail, and the 
objectives- are revisited in nearly every training program we run, 
even in 6ur most senior management development course for corporate 
executi ves. 

The positive working environment was greatly enhanced by an 
early decision to organize the company Into relatively independent 
product divisions, each operating as a small business with Its own 
functional management and product charter. This has kept for us a 
small company atmosphere that encourages entrepreneurship and 
Innovation. 

fXir basic staffing policy is to recruit the best people that we 
can find and put them into real jobs where they have a chance to make 
an immediate contribution. For example, new engineers are assigned 
to d new product development team, and new MBA's recruited into 
mdrkttting go on the road to talk to reai customers. New people are 
(jiven an opportunity to learn by making mistakes, and all employees 
are encouraged to stick their necks out. Lessons learned by making 
mistakes are usually retained. To foster creativity we allow unusual 
individual autonomy and challenge people by keeping decision making 
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and responsibility at the lowest pcs ble level. We encourage 
informaUty with the use of first namtrs, shirt-sleeve management, 
open offices, Informal cw^niunl cation across organizational lines, and 
flexible working hours. Sixty-four percent of our esiployees partici- 
pate In our stock pu'*chase program, and all employees share In the 
company's profits. 

At ^Mlett -Packard we promote from within the company. This 
makes opportunities for advancement real to our people and also 
stimulates training and development at all levels. If you are 
required to promote someone frm within to fill a management opening, 
iou are much more apt to be willing to spend time, effort, and money 
on continuing development of your employees. Managers learn early In 
their careers that their only source of success Is their people, so 
if they want to be more successful, th^ should work on those things 
that will make their people more successful. 

We think a good test of tte working environment Is whether the 
organization has been successful In getting people working together 
toward common goals. Managers at all levels are evaluated and pro- 
moted on their ability to engender teamwork. We encourage managers 
to "manage by wandering around" as it Is difficult to lead if you are 
not out with your people. I have never seen a manager at HP fail who 
was the leader of a successful team! 

Like many U.S. companies we have implemented quality circles at 
HP where we call them (^allty Teams. We have about 1,000 teams in 
place worldwide in our manufacturing and sales entitles, and feel 
that they are natural extensions of the HP way. We hope to fully 
integrate the Quality Team process into our regular management 
function during the next few years. 

A major objective for our corporate training and development 
activity is the perpetuation of our management style and working 
Kfn^irunment, and management training is very fundamental to this 
perpetuation effort. Although I will not spend appreciable time 
describing our management development programs, I did want to share 
with you our basic strategy. This strategy is based on four levels 
of (Tidn»*gc.T.cnt transition (Table 2). The major developmental needs of 
the newly promoted manager at each level have been identified, and 
itidnagement development courses and seminars have been developed for 
each transition. A common characteristic of the curriculum is the 
teaching of those principles and practices that have proven success- 
f jl ^t ^tewlett-Packard as well as a strong emphasis on the Implemen- 
tdtion of the Corporate Objectives. The overall strategy focuses on 
tne "blocKing and tackling" of management development, and implemen- 
tation ts at tne local level in all cases except for seminars in 
functional and general management. 

The first level of supervision has a significant amount of 
influence on the working environment of an organization, and for this 
r^'d'jon, we pay close attention to the develupment of new managers, A 
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management development progran consisting of a series of mwiules (in 
essentia} management topics Is taught In each of our entitles using 
local Instructors, most of whom are line managers. The corporate 
developed curriculum emphasizes itewlett-Pacicard management philoso- 
phy, as a prime objective of the program Is the perpetuation of the 
HP Way* As the most successful managers <teye1op their skills on the 
job working for a manager i#teo Is a ^>od codch, we recently developed 
and Implemented a program, "Managing Hanagers," to provide new mana- 
gers of first level managers an opportunity to develop skills In 
leadership, coaching, team building, managing differences, and 
wiorking with their boss. The basic content of our programs for first 
and second level managers is shown in Table 3. 

Becoming a functional manager at HP Is perhaps the most diffi- 
cult transition, ftanagers promoted to this level normally have spent 
their entire career in one functimi, frequently engineering, 
marketing, or manufacturing* and have only limited knowledge of other 
functional areas. As a functional manager, they join the senior 
mdnagement team of a division or sales entity, and their success 
depends heavily on how familiar they are with the management of other 
functions. 

The "Management Seminar" is a week Iwg program, normally held 
in Palo Alto, that provides intensive coverage of management concerns 
of all functions as well as tutorial sessions in accounting and 
finance. Instructors are experienced HP general and functional 
managers supplemented with faculty from graduate schools of business. 
An HP developed computer simulation exercise provides each attendee 
an opportunity during the week to "manage" a function other than his 
own as part of a seven person management te^m. 

The transition to general management requires that the manager 
develop skills critical to leading a team of functional managers 
responsible for a 500 to 2000 person division or sales entity. The 
bdsic needs for this transition are met by the "Executive Seminar." 
The curriculum emphasizes strategic management, financial analysis, 
product strategy, financial control and measurement systems, 
economics, general management, and organizational behavior. The 
faculty Is balanced between HP executives and graduate business 
school faculty. 

An "Advanced Management Program" was designed in 1979 for senior 
general managers and corporate executives. This program develops 
skills In long term strategic thinking. Attendees develop likely 
scendrios for the next decade as well as a strategy for optimizing 
the company's success In these scenarios. Faculty Is drawn from 
leddinq graduate schools of business. 

I would like to commeri now on some management development 
■ictivUles In our company that are specifically directed at making a 
s'jnif leant jmprovement In overall effectiveness and productivity. 
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Although we have had a tradition of quality workmanship since 
our founding, several jrears a^ we tegan to recognize that we could 
gain an Important competitive advantage If we could make even greater 
Improvements In our product quality and production costs. After some 
studies In some of our divisions, we discovered that higher quality 
actually costs less. One division estimated that if It did every- 
thing right the first time, and on time. It could gat by with one- 
third fewer people, one-fourth less space, and two-thirds less 
inventory. Many of our senior functional managers attended various 
training courses and seminars on productivity and quality methcKis, 
and this activity certainly made some contribution to our efforts. 
We recognized, however, that many of our divisions were well ahead of 
the state of the art in many of these areas, and our corporate 
training and development organization was encouraged to figure out a 
way that these *best practices" In our company could be Identified, 
documented, and passed on to every division on a worldwide basis. 
The result was the development of a Manufacturing Management Seminar 
that has now been Implemented throughout Hewlett-Packard. I think 
that It is Important to note that this program has gone way beyond 
the training of our manufacturing managers and the interchange of 
"best practices.** It also gave top management an opportunity to set 
expectations for the manufacturing function. An outline of this 
program Is shown in Table 4w Each session was developed by HP 
managers who excelled in a particular phase of manufacturing manage- 
ment. In a few cases, graduate buiiness school faculty were used to 
supplement the HP developed material. Much of the content was video- 
taped in our corporate TV studios for consistency in presentation, as 
the program was Implemented locally in each division. 

The final example that I would like to use this morning is a 
program for enhancing RSO productivity. R&D productivity is 
dbsolutely critical to our company's success. The first part of our 
R&D productivity effort is a training program for R&D project 
managers that was recently developed and introduced worldwide. The 
course was developed internally using our very best R&D managers to 
develop the curriculum, much of it based on "best practices" in our 
divisions. An outline is shown in Table 5. Like the manufacturing 
management seminar, a major part of the program is videotai^ -based to 
insure consistency. Setting management expectations through this 
focused training program on R&D management was also an objective of 
the seminar, and it was introduced to our divisions via a live tele- 
conference originating from our Palo Alto headquarters. Although we 
had previously used live telecasts for product training of our sales 
and support people and for new product press conferences, this was 
the first time that we had used this medium for management develop- 
ment. Uur president and other members of our top management team 
were able to communicate their expectations to all of our engineering 
managers In our remotely scattered divisions simultaneously. The 
seminar content was described in detail by the people who developed 
tne pruyram, and our divisions were told how to get the program 
started. 
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The second component of our R&O productivity prografl) Is the 
continuing education of engineers and computer scientists, and 
although we have had a formal program since the early 1950's» It has 
recently assumed an even more important role in our R&D productivity 
efforts. I am sure you are all aware of the serious engineering 
shortage that our country faces, Tte American Electronics 
Association recently projected tte need for t^ U.S» to triple the 
output of new electrical engineers and c<raputer scientists within the 
next Ive years to meet the growth objectives of the electronics 
Industry. Even if this estimate is on the high side, ttwse of us in 
high technology Industries will really have to scramble to meet our 
needs for technical people. This problem could be lessened if we can 
figure out some ways to make more productive use of the engineers and 
computer scientists that we already have. Continuing education, 
particularly keeping technical professionals current in their 
technology, provides tremendous leverage in R&D productivity. 

Unfortunately, due to rapid changes in technology, the so-called 
"half life" of an engineer is estimated to be somewhere between 3 and 
5 years. For these i^ple to just stay up-to-date. It suggests that 
they would need, over a 40 year career, to be reeducated 8 timesl 
Moreover, recent graduates are not able to master the required know- 
ledge during tte standard four year curriculum, and much of their 
education requires deferral to their working life. We are expanding 
our efforts in the continuing education area. We currently have over 
40U engineers and computer scientists taking graduate level courses 
at Stanford University, and additional programs In other universities 
help us meet this critical educational need. The continuing educa- 
tion of working engineers and other professionals should be a major 
objective for training and development in the years ahead. 
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TABLE 1 



THE HEWLETT-PACKARD OBJECTIVES 



1. PROFIT 

To achieve sufficient profit to finance our company 
growth and to provide the resources we need to achieve 
our other corporate objectives. 

2. CUSTOMERS 

To provide products and services of the highest 
quality and the greatest possible value to our 
customers, thereby gaining and holding their respect 
and loyalty. 

3. FIELDS OF INTEREST 

To build on our strengths In the company's traditional 
fields of interest, and to enter new fields only when 
it is consistent with the basic purpose of our 
business and when we can assure ujrselves of making 
a needed and profitable contribution to the field. 

4. GROWTH 

To let our growth limited only by our profits and 
our ability to develop and produce Innovative products 
that satisfy real customer needs. 

5. OUR PEOPLE 

To help HP people share in the company's success which 
they make possible; to provide job security based on 
their performance; to insure them a safe and pleasant 
work environment; to recognize their individual 
achievements; and to help them gain a sense of 
satisfaction and accomplishment from their work, 

6. MANAGEMENT 

To foster initiative and creativity by allowing the 
individual great freedom of action in attaining well- 
defined ob j ec t i ves . 

/. CI TUENSHIP 

To honor our obligations to society by being an 
economic, intellectual, and social asset to each nation 
^nd each community in which we operate. 
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TABLE 2 



HEWLETT-PACKARD COMPANY 
BASIC TRAINING PROGRAMS 

TRANSITION PROGRAMS 

TO CSNEflM. MANAGCft EXECUTIVE SEMINAR 

TO FUNCTtO»IAL MAHACER MANAGEMENT SEMINMI 

TO MANAGER OF MANAGERS IMNACING MANAGERS 

TO MANAGER MANAGEMENT DEVELOPMENT PROGRAM 

INTRGOUCTION TO MANAGEMENT 

NON MANAtXRS WORKING AT HP 

NEW EMPLOYEE ORIENTATION 

TABLE 3 

BASIC MANAGEMFiNT DEVFJLOPMENT- 



PROGRAM ATTENDEES 

iNTTOOt^TIW TO NEW MANAGERS 

MANAGEMENT 
(SELF-PACED) 



MANACr»ffNT NEW MANAGERS 

DEVELOP^NT 
PROGRAM 



MANAGING MANAGFRS MANAGERS OF 

MANAGFR'^ 



CURRICULUM EMPHASIS 

ROLE OF THE MANAGER 
MANACIW; THE yiP WAV 
CI»««^ICATirC WITH PEOPLE 
AtmiNISTRATlVE TASKS 
PERFORMANCE EVALUATION 
AW SALARY ADMINIS- 
TRATIS 

MANAGING AT HP (MANAGEMENT 

BY OBJECTIVES) 
PERFORMAf«:E EVALUATION 

AND DEVELCFMENT 
SALARY AmiNlSTRATItm 
AFFIRMATIVE ACTION 
SELECTION AND INTERVIEWING 
LEADERSHIP 
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LEADERSHIP SKILLS 
COACHING 
TEAM8UIL0INC 
MANAGING DIFFERENCES 
WORKING WITH YOIR BOSS 
EFFECTIVE I^ETING*; 



TABLE 4 



HEWLETT-PACKARD COMPANY 
MANUFACTURING MANAGEMENT SEMINAR 



RSINESS STRATEBY 
MANUFACTUItMB STUATECY 
NEW MOOUCT OCVELOFMENT 
HARKETINC 

OUALITY/PflOQllCTIVITV 
ASSET UTILIZATION 



MANAGING MANUFACTURIMC COSTS 
MATERIALS MAMAGEMENT 
IMTORMTIflN SYSTEMS 
AUTOMATION 

LONG RANGE CAPACITY PLANNING 



TABLE 5 

HEWLETT-PACKARD COMPANY 
R&D PROJECT MANAGEMENT SEMINAR 



WJLE OF R t 0 PROJECT MANAGERS AT HP 



riNANCE 



STRATEGY 



MANUFACTURING 



PROJECT LIFE CYCLE 



lUALITY ASSURANCE 



PLAfMINC ANO CONTROLLING 



INTERRJNCTIONAL PROBLEM 
Sa.VINC 



MANAGING MEMBERS OF TECHNICAL STAFF 



EFFECTIVE MEETINGS 



MARKETING 



PRtJOUCTlVlTY 



' The devek^^ment ofsctKX)! norms which support the continuous study 
and improvement of teaching Uiiids capat^lity for any kirKi of change, 
whether it t)t adbptkm of a new curriculum, schooi-wkte discipline poii- 
ctes, or the txjilding of teaching repertoires." 

Teachers have so Ityig worked in isolation that serkxis distorttons have 
often devekyped about personal competence. Principals must work to 
establish new norms that reward collegial planning, putik: teaching, 
constructive feedback, and experimentatk)n." 

' The knowledge about effective training combined with new under- 
standing of the organizational requirements for chan^ places us in a 
favorable position to attack educational problems and have some hope 
for effective solutions." 
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StHUUL IMPHOVEMENT THROUGH 5TAFF DEVELOPMENT: 
THE COACHING OF TEACHING 



Beverly ^o«fefS 
College of Education 
University of Oregon 



This paper rests on two propositions. First, that Inservlce 
training must be radically changed In order to result In the transfer 
of training to classroom practice; and second, that Inservlce 
training must be embedded jn coherent school Improveraent systems in 
order for chan^ to be sustained. 

Research on training has demonstrated that with thorough 
training, which Includes theory, demonstration, opportunities for 
practice and feedback, most teachers can acquire skills and 
strategies previously absent fr<m their teaching repertoires (Joyce & 
Showers, 1982, in press), l^fortunately, that same literature 
suggests a failure to transfer new knowledge and skills to classroom 
practice, or, if initial transfer was accomplished, a rapid attrition 
oF new behaviors over time (Fullan, 1982). In addition. If the 
object of training was addition to teachers' repertoire of skills and 
strategies radically different from their normal teaching styles, as 
contrasted with fine tuning of existing behaviors, transfer was 
unlikely to occur at all (Joyce & Showers, In press; Showers, 1982). 
Teacher trainers have for so long assumed that transfer would occur 
once skills were mastered that we have had to rely, for the most 
part, on researchers who study the change process to discover that 
much of our training has disappeared at the point we most care 
dbout--the Interaction between teachers and students. 



Training Studies 

Concern for the transfer of training has motivated a series of 
training studies designed to build understanding of the problems of 
transfer. Increase rates of transfer of training, and determine the 
extent of attrition er time when training was boosted by the 
coaching of teaching. 



T he Coaching of Teaching 

Ihe first study (Showers, 1982) trained 17 junior high teachers 
of language arts and soda! studies In three models of teaching which 
represented new repertoires for the subjects. All teachers were 
trained together for eight weeks (three hours per week) in a setting 
which included theory presentations, demonstrations of the new 
strategies, peer teaching sessions with feedback from peers and 
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trainers, dnd practice with students In their own classrooms. At the 
close of this Initial training per1(Kl, all teachers Mere administered 
a conceptual level test (Hunt et al., 1978},. and were Interviewed 
re9ard1n9 their attitudes toward the training and their perceptions 
of tne usefulness of the newly-learned strategies. Teachers were 
then bicxKed on conceptual level ano randORljf assigned to either a 
coached or uncoact^ treatment c(md1t1on for the next seven weeks. 
During the treatment period, all teachers were encouraged to use the 
new strategies and were observed in their classrooms regularly. At 
the end of the treatment period, all teachers performed a transfer 
task In which they taught the same unit of material to one class of 
students. 

Transfer of training scores was computed for the project 
teachers based on their skill with the strategies, the appropriateness 
Mfith which they used the new models of teaching in their classrooms, 
the degree to which they were able to teach their students to operate 
comfortably and efficiently with the strategies, and the frequency 
with which they employed the strategies during the treatment period 
and the transfer task. The maximum fN}Ss1ble transfer score was 18. 

The mean transfer score for coached teachers at the end of 
training was 11.67 and for uncoached teachers 5.75, Conceptual level 
operated as predicted only for the coached teachers (see Table 1). 
Interaction of the coaching treatment with conceptual level Indicated 
that high CL teachers who were coached transferred training at a much 
greater rate than did low CL coached teachers, but uncoached teachers 
transferred training at a very low rate regardless of their 
conceptual level. 



TABLE 1 




Mean Transfer bcores for Coached 

By Conceptual 


and Uncoached Teachers 
Level 


Coached 


Uncoached 


HI 13.6 


5.5 


CL 




LO 9.2 


6.0 



Interestingly, at the end of Initial training and again at the 
end of the treatment period all teachers from both groups reported 
positive attitudes toward training as well as Intentions to use the 
Of?** strategies In their classroom Instruction. Those teachers who 
hj.j not used the strategies during the previous 10 weeks nevertheless 
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felt that during their summer break they would Incorporate the new 
models of teaching Into their instructional plans for the coning 
school year. 

This first coaching study also yIeU i inforfflation on the diffi- 
culties experienced by teachers as timy attenpted to transfer complex 
new teaching strate9les Into their Instruct 1<»ia1 repertoires. 
Teachers reported concerns with additional time required for new and. 
at first, more awkward teaching techniques, anxieties regarding 
possible nanagesient problems resulting frm teaching strategies that 
elicited different sets of pupil behaviors, and fears that their 
experimental behavior would not be supported by aiknlnlstrators. The 
moit serious problem, however, lay In finding appropriate occasions 
for use of the new strategies. Teachers who had typically relied on 
curricular materials provided by their state or district for organi- 
sing courses found It difficult to reorganize material In ways 
suitable for the new strategies. For example, teachers using a 
social studies text organized by countries found It difficult to draw 
from their subject/curriculum four or five underlying concepts the 
mastery of which would enable students to examine similarities/dif- 
ferences across cultures. Or teachers using English texts that 
emphasized structural analysis of the language were puzzled about the 
appropriate scheduling of strategies that focused on writing skills. 

The power of coaching in attacking transfer problems was 
apparent in our final results. Teachers who were not coached 
practiced the new strategies less and therefore developed less 
technical skill in the use of the models. Because uncoached teachers 
practiced le« their students had less opportunity to master new 
sets of resp required by specific strategies, and therefore, 
their teache 'ver reached a level of comfort with the strategies 
that might h«. encouraged further use, Uncoached teachers who did 
continue to i. ce occasionally but without the analysis and 
feedback prov oy coaching did not, for the most part, develop 
greater skill . he strategies. As learning psychologists have 
tdught us, practice without feedback tends to make us more and more 
proficient In our mistakes. 

Coaching in this study was provided by a single consultant who 
observed each teacher in the coaching sample once a week and then 
conferred with that teacher to provide feedback, support and encoura- 
gement, assistance in planning future lessons, and occasionally, to 
help with the location and production of materials. 



Long -Term Effects of Coaching 

A second study followed up our first set of teachers six to nine 
months after the close of the first project to determine if skills 
and transfer of training were retained (Baker, 1983). We were also 
curious to discover If, as In the Sharan & Hertz-Lazarowitz Study 
il^HZ), there might exist a "lag" effect whereby teachers improved 
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the skill and appropriateness with which they used complex new 
strategies after a summer break. 

Baker asked teachers In the Showers* sample from the previous 
year to demonstrate lessons with the strategies learned and to be 
interviewed. Several results are noteworthy here. First, coached 
teachers maintained their advantage in both skill and transfer six to 
nine months after training (see Table 2}. Second, transfer scores 
increased for both coached and uncoach«d groups of teachers during 
this period* Althougli teachers reiHirted that they were no more 
proficient with the strategies than they had been at the close of the 
previous school year, their actual transfer scores provlcted some 
support for a '*lag" effect following strong training. Finally, 
several of the uncoached teachers found they were unable to demon- 
strate the models at all following a several months-long hiatus In 
practice with the strategies. While this had the effect of 
artificially Inflating the transfer scores of the remaining uncoached 
teachers, a significant difference still existed tetween the tws 
groups. 





TABLE 2 






Persistence of Training Effects 




Coached 


Uncoached 


Skill 


4.0 


2.9 


Transfer 


15.25 


10.7 



Peer Coaching 

A second study by Showers (1983, in press) investigated the 
effects of peer coaching on teachers' ability to transfer new models 
of teaching into their instructional repertoires. Specifically, the 
study sought to discover if peer coaches could be trained to provide 
consistent coaching to a new group of trainees and if a peer coaching 
treatment would replicate earlier effects of coaching. Furthermore, 
•*e hoped to determine the degree of teacher collegia! ity developed by 
d peer-coaching approach to training. Little (1982) reported that 
schools with norms of "learning on the job" and continuous improve- 
ment rtere characterized by high degrees of teacher collegia! ity. 

Six peer coaches (drawn from teachers who participated in the 
first Showers' study) each coached two to three teachers following an 
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initial six-week training period for 19 teachers In two models of 
teaching (n»13 coached teachers and 5 uncoached teachers). Peer 
coaches observed each of their trainees one period per week aiHl <»et 
Mlth them following the observation for the coaching sessions. 
Specifics of the coaching treatment ifere modeled after the procedures 
developed by Showers in her 1982 study. Trainees were assigned to 
peer coaches on purely logistical grounds (e.g.. teachers' choice of 
class to work with, placement of preparation periods, and in some 
cases, distances betweoi sch<M>1s). 

At the end of the project, the mean transfer score for peer- 
coached teachers was 12.00 {S.0* « 2.10) and for uncoached teachers 
the mean transfer score was 9,5 (S.D. ■» 1*27). Furthermore, 

coached teachers reported unanimously that the peer ^coaching had been 
a positive experience Irath professionally and interpersonal 1y. Given 
that several trainees had expressed concern at the start of peer 
coaching regarding their {articular peer coach, we were relieved to 
discover that the coaching experience had remained consistently at a 
highly professional level, despite several previous conflict 
situations. 



Staff Developflgnt and School Improvewant 

The role of staff development in school improvement appears to 
be of critical importance. Whatever the content of inservice 
training, if it represents an addition to repertoire for partici- 
pating teachers, training will need to be considerably more Intensive 
than is normally the case if new behaviors are to be integrated Into 
classroom practice. The provision of coaching following Initial 
training, even very strong training, apparently Is essential for most 
teachers if new skills and strategies are to be appropriately 
implemented. 

Implementation of a peer coaching program in a school has 
effects much more far reaching than the mastery and integration of 
new knowledge and skills for individual teachers. The development of 
school norms which support the continuous study and improvement of 
teaching builds capability for any kind of change, whether it be 
adoption of a new curriculum, school-wide discipline policies, or the 
ouilding of teaching repertoire. By building permanent structures 
for collegia! relationships, schools can organize themselves for 
improvement in whatever area they choose. The studies reported here 
hdve demonstrated both the necessity for fully elaborated training 
systems (as contrasted with the more common one-shot inservice 
offerings) and the viability of peer-coaching relationships. 



Implications for leadership 

The design and implementation of powerful training systems is 
unlikely to occur without thoughtful and determined leadership at 
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both the district and building levels. Attalnistrators will have to 
carefully examine priorities for staff development and the allocation 
of funds to staff development activities. Whatever the sl^e of a 
district /school staff development budget, few budgets can sustain 
both Intensive, focused training and numerous one-shot activities at 
a very high level of funding, decisions nust be made regarding the 
outcomes expected of staff development programs. When the desired 
outcome Is simply increased awareness of a subject* funding might 
legitimately support the occasional two-hour speaker. When, 
however, the ex{»cted outccme of staff development Is change In the 
instruction students receive, funding will probable have to be 
focused more narrowly In order to support the magnitude of training 
necessary to bring atout that change. 

Organization of peer -coaching systems will most likely need to 
be cooperatively arranged between district administrators and school 
sites. In schools where teachers already have preparation periods 
scheduled into their work days, teachers can be organized Into 
coaching teams for collaborative planning and feedback sessions. 
Some schools have used specialist teachers to release teachers for 
observation periods, and some principals have taken classes in order 
to provide observat1<^ times for teachers. In other cases, teachers 
have had to videotape lessons for sharing at a later time when live 
observations could not be arranged. In the peer coaching study 
reported here, substitutes were provided for peer coaches one day per 
week in order for them to complete their observations and confer- 
ences. Creative problem-solving by teachers and administrators will 
almost surely result in solutions to the time demands of the 
continuous study and analysis of teaching. Without the active 
support and involvement of building principals, however, few teachers 
Mfiii be able to establish such systems for themselves. 

Principals must do more than assist with the logistics of peer 
coaching systems If they are to become institutionalized. Teachers 
hdwe so long worked in isolation that serious distortions have often 
developed about personal competence. Principals must work to 
establish new norms that reward collegial planning, public teaching, 
constructive feedback, and experimentation. Professional growth must 
be seen as a valuable anc* xpected process and clearly separated from 
tne evaluation of perfor a/ice. 

Not only are principals in a unique position to influence 
building norms, they are also perfectly situated to facilitate the 
implementation of peer-coaching systens through collaborative 
problem-solving with their teachers. Flexible scheduling for 
training, observation, feedback and planning can be uniquely planned 
to meet the needs of individual faculties. Available rewards and 
incentives can be brought to bear to encourage developing norms of 
collegia! Ity. Parents and community members' support can be 
solicited by explaining the purpose and expected outcomes of 
intensive staff development programs embedded in larger school 
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improvement efforts. And principals must Initiate these activities 
if they are to have an> hope of affecting entire schools. 

Finally, principals can uie their Influence to ensure that 
quality inservice programs are provided for teachers. Coaching pro- 
grams roust have some content to coach, and the greater the expertise 
brought to bear on identified problems, the greater the dividends 
from a coaching effort. 

We understand more about the change process today than at any 
time in the past 50 years. The knowledge about effective training 
combined **1th new understanding of the organizational requirements 
for change places us in a favorable position to attack educational 
problems and have some hope for effective solutions. All those 
involved in the educational endeavor have important roles to perform 
if i*e are to succeed in creating excellent schools. The knowledge 
base exists to guide our efforts. Let us begin. 
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" 'In every school there are teactwrs who have the interest and ability to 
share their well-developed expertise with their peers. Too often 
because of time constraints and past practice, tlwir talents were not 
tapped. The Instructional Suf^rt Team provides a vehicle fordevetop- 
ing and using staff expertise." 



' ' The Instructional Support Teams may advise the principal and assist in 
the planning and imp^menting of any activities which affect the school. 
Principals express enormous enthusiasm for having a group of teacth 
ers to provide staff input and help in decision making." 
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IMPROVING INSTRUCTION WITH SCHOOL-SITE SUPPORT TEAMS 



Judy Gull key -Amddo 
Director of Professional Development 
Vallejo City Unified School District 

Ellen Nims, Principal 
Cooper Elementary School 

Dorothy Elliott, Instructional Associate 
Cooper Elementary School 



A great deal of the literature on school Improvement and 
instructional improvement focuses on the leadership abilities of the 
principal and on the components of effective classroom Instruction. 
The Teacher Center movement focused attention on the importance of 
peer support among teachers. There Is currently legislation and a 
great deal of interest in the concept of mentor teachers. The 
Vallejo Professional Development Center has tried to combine the best 
of both worlds by developing a program to train Instructional Support 
Teams composed of principals and teachers from each school in the 
district to promote instructional Improvement at their own sites. 
This paper is a description of that effort. 

This paper will describe the program that began In September 
1981 and is currently being implemented to use Instructional Support 
Teams in the Vallejo School District, First, background information 
will be given to provide a contextual description of the school 
district setting, the recent history of staff development programs in 
the district, and the entire district stc.ff development program. 
This will provide a necessary backdrop for understanding the 
rplationshlp between the support team and previous and ongoing 
proqrams. Second, a philosophical and conceptual description of the 
purpose of the teams will be provided. Third, the selection, 
training, and function of the teams will be outlined. Fourth, a case 
study will be provided of the operation of an Instructional Support 
h'dm in one elementary school from the perspective of a principal and 
tedcher fuember of a team. 



BACKGROUND INFORMATION 

It IS important to provide a description of the context in which 
'in.,r,f uctiond! Support Teams were developed in Vallejo because the 
program evolved as a part of a long-range, district -wide, comprehen- 
•ii/e '>tdft de</elopment program. The school district, itself, is a 
medium -si zed school district by California standards, in a small 
iT)jn jjmmtjnity. The school district began developing a comprehen- 
.1/^' district staff development program In 1976. The Instructional 
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HHtory of the Vallejo Staff Developfflent Program 

Th« Vallejo School District began developing a district -«ide staff 
developfflent pro^ran. The original source of funding was the State 
Professional Development Program Improvement Center which, at 
that tiffie, allowed services to be provided only to Title I schools. 
Conseqiently* the Vallejo program initially served only the ten Title 
I elementary schools. Plan were developed to include the remaining 
five elementary schools and the seven secondary schools. In ig78 
Federal Teacher Center funds provided the resources to Include all of 
the non -Title I schools. The Vallejo professional development pro- 
graiDS have been funded by a variety of sources since its inception. 
It is now primarily funded by Chapter II and district funds. 

Tne foundation of the Vallejo Professional Development Center 
training In instructional effectiveness and instructional supervision 
hds been the work of Madeline J^nter^As the training program has 
grown, tne work of many others has been integrated including Bruce 
Joyce, Gene Hall, the Beginning Teacher Evaluation Study, Fred Jones, 
etc. Each year, the program changes based on teacher needs, district 
programs, and current research findings. A strong emphasis on class- 
room observation, feedback, and coaching has been present in the 
Vdllejo program from the beginning. 



Current District Staff Development Program 

The current district program has many components. Individual 
teachers may request to attend cycles during release time that focus 

on : 

• Instructional Effectiveness {Hunter) 

• Curriculum 

- The District Curriculum Management System 

- Math 

- Science 

- Social Studies 

- Engl ish 

- Writing 

t cm Id Development 

• Classroom Management 

• Nutrition 

• Special Needs 

• Parent Involvement 

5 very semester a ten-week a^ter-school series is offered for 
crt'dit on topic areas of particular interest to teachers. Several 
after -scnoo! series on computer use are currently being given. The 
Bdy Area Writing Project is offered in summer and after -school 
oyJes. Every summer, workshops are offered for credit on topics 
KlMnttfied as hiyh interest or need areas by teachers. 
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The district hds a system for granting district professional 
dsvelopnent to Individuals and groups of teachers for engaging In 
professional developnent activities outside of the duty day. A 
district committee composed of six teachers nominated by the district 
and an administrator appointed by the Superintendent approves or 
disapproves requests for credit and C(»sp1eted activities. The 
Director of Professional Development Is the secretary to the 
committee and all records are maintained in the Professional Develop- 
ment Department. 

The district program Just described provides professional 
development services to Individual teachers. The cycles are taught 
by teacher trainers and augmented heavily by classroom teachers that 
have particular areas of expertise. Throughout the existence of the 
Valiejo Professional Development Center, an ongoing training program 
for site administrators In instructional supervision has been 
conducted. -The Instructional Support Team training Is a separate 
function of the Professional Development Department and will be 
described later in this paper. 



PURPOSE OF THE INSTRUCTIONAL SUPPORT TEAMS 

By 1981, the district had site administrators who had received 
several years of training in instructional supervision, and a large 
group of teachers who had been refining their Instructional skills 
through training and daily practice in the classroom. A need existed 
to strengthen school -site staff development programs and support 
systems in addition to maintaining a strong district-wide training 
proyram. The Instructional Support Teams were formed to recognize 
and use the talent available at the school site and to increase the 
amunt of feedback and coaching available to classroom teachers. 

The main purpose of establishing Instructional Support Teams was 
to improve instruction oy increasing school -site leadership and team- 
*iorK between administrators and teachers. Underlying the entire 
professional development program is the belief that a common language 
/ind ffdinework for analyzing and refining teaching is essential to 
instructional improvement. Administrators in Valiejo play a central 
jnd important role in teaching and using a common language, but so do 
teachers. Teachers who have successfully applied teaching skills in 
tne classroom provide the richest source of expertise the district 
nas. 

^ strong commitment exists in Valiejo to fully develop and use 
■,'.nuo! -SI te leadership. Each school has unique needs and strengths, 
inii d very special set of resources. An underlying premise of the 
Instructional Support Team program is that each school must assume 
•inf responsibility for its instructional program, but that the dis- 
t-i/.t needs to provide the necessary leadership, support, and 
'"••'T<;ir^,»>s to enable each school to meet school an^ district goals. 
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TeamMork Is a very Important theme In Vallejo. There Is a deep 
conviction that goals are best accomplished by teams. The Instruc- 
tional Support Teams are one manifestation of the cofflrottment to 
teamwork between administrators and teachers. Administrators are 
expected to provide leadership by sharing risks and decisions with 
teachers. Trust Is best built by successfully meeting challenges 
together. The Instructional Suppo't Teams provide an Important 
vehicle for teacher leadership and ownership of the school program. 



ORGANIZATION OF SUPPOKT TEAMS 

The Vallejo Instructional Support Team program was built on a 
strong foundation of individual staff development and administrative 
training. It is important for other districts to recognize the 
length and depth of previous professional development efforts in 
Vallejo before adopting or adapting tlw program. Almost every member 
of an Instructional Support Team has had a number of years of 
training and practice prior to the advent of Instructional Support 
Teams. This section will describe selection procedures, training, 
and function of the Instructional Support Teams, 



Selection 

Each school in Vallejo has an Instructional Support Team, The 
principal has the primary responsibility for working with the Central 
Office staff and the school -site staff to select Instructional 
!>upport Team members. Each team consists of the building principal 
and four or five teachers. Secondary school vice-principals are also 
te<jm members. The following criteria were used to select teacher 
members of Instructional Support Teams; 

• Demonstrated excellence in the classroom in terms of using 
elements of instruction to teach the state and district 

curricul um. 

• The respect and confidence of the principal, 

e Kespect, confidence, and credibility with the staff, 

• Previous district training in teacher effectiveness. 

• Demonstrated willingness to learn and help others learn. 

• Willingness to commit time to meet with the support team, 
trdin other teachers, and act as a peer coach. 

Instructional bupport Team members do not receive additional 
'.omiv*»nsdt ion. They are provided with release time to attend training 
I'l'i, whenever possible, are released to observe other classrooms and 
■^rf)j\6e feedback to teachers. 
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Instructional Support Team Training 



The 1983-84 school year marks the third year of existence of the 
instructional Support Teams. Each year has had a different training 
focus. The first year focused on developing skills to observe and 
analyze teaching and plan and deliver instructional conferences. The 
second year focused on developing skills to observe and provide 
feeiback to teachers in classroom management. Tlie third year is 
focused on developing school level Instructional improvement plans 
for the 1984-85 school year. 

Instructional effectiveness (1981-82). The training program has 
two basic components, In-Center training and on-site follow up. In 
t^e 1981-82 school year, the participating principals and teachers 
received six to eight days of training in instructional effective- 
ness, lesson analysis, and conferencing skills. In the Center, they 
focused on increasing their individual and collective skills as team 
members in observing and analyz1n9 teaching and planning conferences. 
At the school site, the Instructional Support Team practiced their 
sKills and developed a support network. Principals and teachers 
scheduled classroom observations In volunteer teachers' classrooms. 
They practiced the observation and conferencing skills they learned 
in the Center and gave one another feedback. A trainer from the 
Professional Development Center was also available to assist in the 
application of new skills. In addition to practicing their own 
ski Ms, the Instructional Support Team planned ways to expand the 
support network by providing other teachers the opportunity to 
observe one another's classrooms and provide each other feedback. 



school -site support teams were trained in the area of classroom 
management based on the Classroom Management Training Program 
developed by Fred Jones. They received six to eight days of training 
in the Center. At the school site, they trained other staff members 
tn classroom management techniques. Classroom observations and con- 
ferencing continued. The support teams increased their repertoire of 
skills so that they could assist their peers with classroom manage- 
ment as well as their instructional skills. Some support teams were 
dUo involved in planning curriculum Implementation activities at 
their school sites. 

School level planning (1983-84). The 1983-84 school year 
focuses on training school support teams In the areas of school 

fecti veness research and school -level planning. Each school will 
develop the capacity to develop and Implement a year-long plan which 
rtiii reflect the school district's Five-Year Instructional Improve- 
r-H.'Dt Plan. The team will also develop plans for continuing observa- 
t'ons dnd conferences and training in classroom management. 

During the early part of the 1983-84 school year, the Instruc- 

jna'- Support Teams will receive training in school effectiveness 




In the 1982-83 school year. 
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and d distnct-ddopted planning process and format. They will 
receive updates from all Instructional Division Departments regarding 
the components to be Included In the plan, firing Spring 1984, the 
Instructional Support Teajfi will work with their school -site staffs to 
write a School -Level Instructional Improvement Plan for the 1984-85 
school year. The following components will be addressed in the 
plans: 

• Use of Standardized Test Data 

• Instruction 

• Curriculum Implementation 

• Staff Development 

• Computer Education 



Function of Instructional Support Teams 

fcdch school has used Its Instructional Support Team In Its own 
way. Functions that are common to all schools are training and 
coaching. Every team has done some training of its school staff in 
areas in which the team, Itself, was trained (instruction and class- 
room management). Every team has provided coaching to teachers and 
many teams have also assisted in curriculum implementation efforts. 
The district has recently adopted new continua, criterion-referenced 
tests, student profile cards, report cards, and courses of study. 
Mdny of the Instructional Support Teams have helped see that the 
curriculum is actually used. 

Principals have used Instructional Support Teams as problem- 
sal ^mq groups. The Instructional Support Teams may advise the 
ijrinj.ipdl and assist in the planning and implementing of any activi- 
ties which affect the school. Principals express enormous enthusiasm 
♦"or f^dving a group of teachers to provide staff input and help in 
<le':ision making, 

i'ict\ Instructional Support Team has made decisions about the 
r,<ij;ness of the school -site staff and the appropriateness of speci- 
f.c d-.ti vities. In some schools, a great deal of teamwork and com- 
i'iyn i.'.dtion dlroddy existed and the Instructional Support Team was a 
n.ir.Nr^i extension of existing activities. In other schools, many 
t'Mcners had been operating in Isolation for some time and the 
initial dctivities of the Instructiona] Support Team focused on 
Dui 1 di ntj trust. 

A very important distinction of function which needs to be made 
'••J'- IS that the Instructional Support Team is not involved in 
t''-^i(.ner eyal uat ion. Because peer coaching Is a somewhat new 
;^ht?no'nenQn, this was an Important clarification. Classroom observa- 
':'on Dy support tea^ members are always voluntary an the part of 
lis^room teachers. Under no circumstances would instruct i onal 
^'jUpo'"t T^^dm observations become a part. of personnel evaluation datd. 
.1 ■T.i'iy school s, tt-dchers njye requested instructional Support Team 
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assistance in the accompHstiment of evaluation objectives, but these 
interactions are not part of the personnel record. 

It Is very Important for each Instructional Support Teatn to 
explain its function to the rest of the staff. It Is designed to be 
a support system for teachers, but apprehension has been expressed by 
some teachers. The Vallejo Education Association president has been 
very helpful in clarifying the Intent and use of the Instructional 
Support Teams in allaying fears of teachers. 



CASE STUDY 

Every school, from the smallest elementary school in Vallejo to 
the Urgest comprehensive high school, has an Instructional Support 
ream. This case study focuses on Cooper Elementary School. Cooper 
School Mas chosen because it has a new principal and a staff that did 
not have a history of working together or a strong support network. 
Cooper School provides a relevant case study because it's a school 
that had to start at the beginning In terms of building an Instruc- 
tional Support Team and gaining staff acceptance. 



Principal's Perspective 

Ellen became the Principal of Cooper School In the Fall of 1981, 
tne year Instructional Support Teams were formed. When she came to 
Cooper School, she found a dedicated staff of individuals who were 
accustomed to working In isolation. She followed a principal who 
-il iiost never held staff meetings. Her major goal during her first 
ynar as principal was to develop staff cohesiveness and begin 
•uilding d collective commitment to instructional improvement. The 
.nstructional Support Team was a vital part of Ellen's plan and she 
injje her team a very high priority in her own schedule. 

Forming the Instructional Support Team was a challenge for 
Lilen. Very few of her teachers sa<< themselves as leaders. She 
.onnnred three members of her staff to be on her Instructional 
/jppor t Ifdm. fjne member was a primary grade teacher with 18 years 
■j^ 'Jassfoom experience whom Ellen knew as a colleague at another 
s.fioQi ?ctrher in her career. She had high regard for Dorothy as a 
i.sroom teacher and asked her to be on her team. John, an inter- 
■•■-'.n I'e-.jrdde teacher, was active in setting up school -wide sports 
^ffijrjms. In addition to being a strong classroom teacher, he was 

luH'i by the staff and brouyht a school-wide perspective to the 
'.vj'i. Lind<i, d kindergarten teacher, had previous experience as a 
r,',./,f.,H r-'d;:hpr in cdtegor ical ly funded programs, bhe, too,' brought 
• ; ^,Mi,Ti isn ■indf.'rs^icindTKj of the school as a whole in addition to 
i'.r^^i'^t.i 1 'Jdssroom tHfjchintj 4>Aper i t?nce- 
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Ellen made the establishment of the teani Itself and a beginning 
acceptance by the staff her first goals for the Instructional Support 
Teaffl^ ftirlns the first semester of the first year, the members of 
the team met with Ellen just to establish themselves a"^ a team. 
Later in the year, Ellen and the Instructional Support Team began 
explaining their purpose to the rest of the staff. Most of the on- 
site practice of lesson analysis and conferencing skills occurred 
within the team. A few visits were made to classrooms of teachers 
who showed a strong interest In and willingness to received feedback. 

During the 1982-83 school year* the Cixiper Instructional Support 
Tear expanded Its efforts. Team members were assigned to work with 
Individual teachers. The Instructional Support Team did not 
necessarily work In depth with every teacher on the staff. They 
assigned themselves not by grade level but by Interest, and began 
forming support relationships with other teachers. For instance* 
Dorothy assisted teachers who had classroom management concerns. 
John worked with teachers who were interested In receiving feedback 
and coaching on their Instructional skills. Linda worked with 
teachers who were interested In more fully developing their reading 
programs or in implementing the bay Area Writing Project. 

The response of the staff was varied. Some staff members were 
very open and receptive to peer coaching. Other teachers were more 
tentative and reluctant. The Instructional Support Team honored the 
readiness of individual teachers. Team members made themselves 
available to the staff and worked in a variety of formal and Informal 
ways based on the responses they received. Ellen and her team agreed 
It was more important to be sensitive to the staff and to build sound 
relationships than to jeopardize the team's effectiveness by rushing 
staff dcceptance. 

During the Spring of 1983, the Instructional Support Team did 
some staff workshops In classroom management based on the training 
'.r\v t^dm hdd received at the Professional l^velopment Center. The 
<:tdift response was very positive. This gave added confidence to the 
'.oop^r Instructional Support f^am and also provided an avenue for 
?nf.re4sed Support activities with the staff. Several staff members 
ffMjiiM^t^d dssistdoce with classroom management after the on-site 
iMor< snops . 

rJ len expanded her team during the 1983-84 school year. Linda 
i^ds t^dnsferred to another school. Two new members have joined the 
:'v,tf i^nond! Support Team to learn the district planning process and 
sv.fK i)n the 'ichool plan. Unlike the beginning of the Instructional 
.■.,.;p<j' *: Fedir, progrdm, LI len had more teachers wanting to be on the 
fHr^m than trdining spaces available^ She created an expanded 
lr-^truLi)ond\ Support Team by developing roles for individuals who 
-li-^M Specific contributions to the school program. One member of the 
.'.^„rKj*»d tt'diu traminy thp rest of the staff in the use of 
■ i'-iPi^H^s in the ;.Ussroom; another member is providing training in 
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the use of the DHtrict Curriculum Management System; and a third 
member Is responsible for school-wide sports activities. 

Ellen speaks glowingly of her Instructional Support Team. She 
foun0 it Invaluable as a first year principal to have a group of 
advisors who already knew the staff. She finds that many of her 
objectives for Improving Instruction at Cooper School are best 
carried out by teachers helping teachers. Ellen places real value on 
Instructional Support Team activities and allocates a generous amount 
of time to meet regularly with her team. She has seen vast changes 
in the Cooper Staff since Fall of 1981. In 1981 very few teachers 
chose to attend training at the Vallejo Professional Development 
Center. Most classroom doors were closed and many were locked. By 
Fall of 1983, every teacher in the school signeil up for at least one 
training cycle at the Professional Development Center and many 
teachers were opening their doors to their colleagues. Ellen credits 
the Instructional Support Team with much of this success. The 
members of the Instructional Support Team give much credit to Ellen 
for her leadership, commitment, and sensitivity. 



Teacher's Perspective 

Dorothy had been a classroom teacher for 18 years when Ellen 
cdme to Cooper School. Ellen and Dorothy began teaching the same 
yrdde in the same school as first year teachers. Dorothy respected 
Ellen and wanted to support her, Dorothy remembers clearly the day 
tllen asked her to consider being on the Instructional Support Team. 
She recalls thinking that she was very comfortable In her role as a 
classroom teacher. She recalls being much less comfortable with the 
njna cjf being a coach to her peers. This was not a role she had 
envisioned for herself, but she agreed to accept Ellen's invitation. 

Dorothy agrees with Ellen that It was Important to take the time 
ti) f)uild the team's confidence and to begin Introducing the team to 
tne rest of the staff. Assigning team members to individual teachers 
^ds an effective way to begin. It provided team members with a 
nirrow<er focus based on Individual Interest and expertise, and 
iJiTiited tna number of teachers with whom to establish a working 
relationship. Dorothy did a Ibt of Informal visiting after school 
and taUing with teachers to begin* establ Ishing rapport. Eventually, 
she began visiting some classrooms. Dorothy has particularly vivid 
T'inones of working with a teacher who had a difficult class and a 
nimber of classroom management concerns. The previous year Dorothy 
r^'i'i i simildr class, so she had a great deal of first-hand experience 
1. whM dS mure recently acquired techniques to offer her colleague, 

bor.jt.hy IS very enthusiastic about her experiences as a member 
of tnn Instructional Support Team. She has learned many new skills, 
jt'i^'fi J great district-wide perspective, and developed her leader- 
,nt;, -jftilittes. She also expresses articulately the benefits to the 
i noo. statf. Shp sees much greater enthusiasm for t'»aching with ner 
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fellow tedcheri, d coiiimltment to ongoing staff development, and 
greater stdff cohesi veness, Dorothy's own career has changed as a 
result of her Instructional Support Teara experience. In Fall, 19b3, 
she became the Instructional Associate at Cooper School. The 
Instructional Associate's position is funded by the school's State 
School Improvement Program, Dorothy finds herself full time in a 
resource teacher or program manager role. Her Instructional Support 
Team training and experience are invaluable as she fulfills new 
responsibilities at her school. 



SUWiAHY 

Vallejo has found many advantages to establishing Instructional 
^support Teams: (1) The Instructional Support Team concept promotes 
shared responsibility between aAninistrators and teachers. Princi- 
pals dre expected to develop their own skills in instructional effec- 
tiveness and share the responsibility for the school program with 
teachers. Teachers are expected to play an active role in working 
with the principal to make key decisions about instruction. (2) The 
focus on classroom visitations, observations, and conferences reduces 
the "loneliness" of the classroom. There is a great deal more inter- 
action between professionals over matters of importance when there Is 
d planned program nth&r than an occasional burst of communication 
aver problems. (3) The Instructional Support Team builds leadership 
capacity. In ever*/ school there are teachers who have the interest 
and ability to share their well -developed expertise with their peers. 
Too often because of time constraints and past practice, their 
talents were not tapped. The Instructional Support Tean provides a 
vehicle for developing and using staff expertise. 

After some Initial apprehension on the part of some teachers, 
the support teams have achieved overwhelming success. The president 
of tne local Teachers' Association has heartily endorsed the teams 
rind encouraged all teachers to view and use the team as a resource, 
the district administration Is thrilled with the surge of teacher 
leadersnlp and the productive, collaborative relationships between 
ttfdchers and administrators that have resulted from the program. 
Principals feel extremely well supported and teachers have expressed 
d qreal deal of enthusiasm f&r the peer support that is now available 
to them. 
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'As enrolment has declined and teachers have left the professk>n, 
existing staff have often been reass^ned to shortage areas, and many 
California teachers are not now working in their primary subject area, A 
mentor assigned as a lead teacher might help existing staff upgrade 
tneir skills in the newly assigned subject area." 



The Mentor Teaching Program is a new opportunity and will require 
f thoughtful planning in order to support educational improvement. Given 
the broad scope of the initiative, it is unreasonable to expect that the 
program can accomplish allgcBis; it is thus essential that teachers and 
administrators work toother to define what the program can do " 
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THE CALIFORNU MENTOR TEACHER PROGRAM 

Laura A. Wagner 
Califonila State Departunt of &iucatlOQ 



Thaok you very mch for Invltli^ wb to apeak on tte Mentor Teacher Prc^raffl 
in California. Thia ia an exciting tise in education, nationally, ac^ pert leu* 
larly here in California where Senate Bill 813-^an osmitms ^ucational reform 
package paas^ the Legialature thia amsKr. 

The hill ia one of the aoat eoQprehensive education finance and refora 
oeasures ever enacted in Celifomiat and contalna over 80 aeparate reform6 
designed to: 

• Strengthen h^gh echool graduation requlr&sents* 
e loprove the el^MOtary aj^ aecondary curriculiun. 

• Tighten atudent dlacipline atandarda. 

e Streamline teacher diaoissal procedures. 

• Improve school-level managercnt. 

e Attract and retain high quality staff. 

Iq 1983, Senate Bill 813 provided an 8 percent average increase for school 
districts » vlth appropriations totalling over $800 million dollars. And, while 
much of the 1984*85 funding vas cut, the funds which were appropriated are 
assisting to both Implement the reform agemla and offset Inidget reductions 
occurring since the. passage of Proposition 13. 

Z mention these other initiatives in the reform package because it's 
important to address the Mentor Teacher Program within the total package of 
reforms rather than attempting to Implement each piece In isolation. In the 
area of staff development » the law provides for a new teacher evaluation proce- 
dures « credential requirements for teacher trainees, grants to Improve and reward 
classroom instruction and provide stipends for n»ntor teachers working in a 
staff development capacity. 

There are a variety of teacher incentive plans which have heen proposed 
and enacted in the United States. Tennessee and Florida both have teacher 
career ladder plans tied to evaluation and salary. These new proposals are 
supported by smaller scale efforts like the one which has worked quite success- 
fully for 30 years In La Doue^ Missouri. 

The California Mentor Teacher Program Is of a slightly diffrrent variety, 
in r.hat this master teacher proposal « while Intending to Improve the structure 
of the teachi.4! profession through a career ladder has a staff development 
component as its central activity. 

The primary goals of the Mentor Teacher Program are twofold: 

1. First, to retain and recognize excellent tear^^cLs, and 

Second, to inprove the profesf>l;^n by aaklng individuals hrlth particular 
expertise available atislst others 
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These goals ate to be acccapliahed by aelectlug oentor teachers and designating 
part of their professional role for staff develo^&t with new or emrl^ced 
teachers* Where appropriate, districts say also have sentor teachers^ work In 
currleulua develo^ent functions^ In return, Mntors will receive a §4,000 
annual stipend and serve up to three years as "mentors*" 

Mentors are not selected on the basis of principal evaluation, and tlwy are 
specifically prohibited froa participating In the evaluation of other teachers. 
Rather, the priaary function is to provide a process for teachers to receive 
assistance in a colleglal setting for nev and experienced teachers* In addi- 
tion, aentors aay vork In curriculum develof^nt or with teacher trainees. 

The teacher trainee provisions In SB 813/1983 (Sections 25,5, 44325) 
authorize the Coomissioa on Teacher Cr^ntlallng to Issue certificates to allow 
ptTsom* with baccalaureate degrees, but no professional training to teach in 
secondary schools, (grades 7-12). Teacher trainees are to work within a profes- 
sional development plan and be guided and trained by a mentor teacher. 

Kentors are not given additional pay simply because they demonstrate 
merit* Rather, they are compensated at a higher rate because they perform 
different duties, sod work longer hours than their peers. Neither the teacher 
trainee nor the mentor teacher provisions are prescriptive. Both are Implea^nted 
at district discretion. Thus, districts have considerable flexibility to design 
mentor programs within an overall approach to upgrading instructional quality. 

SB ^)i3 authorizes districts to designate up to 5 percent of their teachers 
aa mentors. Undoubtedly, many more teachers could qualify and serve with 
distinction in the mentor role. Hopefully, this initial authorization for 
mentor teaching will be a first step in creating a variety of career ladders for 
classroom teachers. However, current funding levels restrict the number of 
mentors that can be selected. 

The Mentor Teacher Program Is a new opportunity and will require thoughtful 
plr.nnla« In order to support educational improvement. Given the broad scope of 
the irtKlative, it is unreasonable to expect that the program can accomplish all 
Koals; it is thus essential that teachers and administrators work together to 
define what the program can do. Issues to consider in developing mentor programs 
inc iudc : 

i • The importance of collaboration with appropriate groups in program planning . 
The success of a Mentor Teacher Program will depend in large measure on 
support and commitment from all those Involved — teachers, governing boards, 
administrators^ and other interested parties. District governing boards 
Intending to participate in the mentor program need to work with these 
)?r<>ups to establish a collaborative approach to program planning. 

^'^ ^i^^^ design reflecting local needs and priorities . Staff training 
flccivities and support are critical elements for fostering teacher and 
organizational change, and sustaining these changes in sufficient depth to 
iap.i t student achievement. However^ there is no single unitary system for 
ptovLdlTi^ staff development. Thus, how the nentor program Is used In 
Individual school districts is expected to vary widely. 



Nevertheless* the prograa should not stand in isolation, but irlll 
relate to other Initiatives nquirli^ broad-hased si^porC from teachers and 
administrators (School laproveaeot, AB 551 » Student Study Teams). Outlined 
belov are mome approaches i^lch have been us^ in master teacher programs » 
which might be modified to define "mentoring'* roles. 

^« Lead teacher or master teacter assigned to provide staff development 
for school staff s As enrollment haa declined and teachers have left 
the profession, ciastiQg staff have often been reassigned to shortage 
areas and many California teachers are not now w>rkii« in tl^ir primary 
subject area. A mentor assigned as a lead teacher might help existing 
staff upgrade their skills in their newly assigned subject areas. In 
this configuration, a mentor teacher would be assigned as a staff 
developer at a school site« A mentor mights 

Provide training, clas8r<^B ol^ervation, conferencing and 
coaching support fcr a group of teachers being retrained. 

Function as a content and methodology s^^dalist at a school 
site for designated grade levels or content areas. 

'^.ach a regular sequence of courses, and be observed by other 
teachers 

Mentor as trainer of new teachers o r teacher trainer . The first year 
of teaching is the most difficult, as research suggests that much of 
what teachers learn about teaching is learned "on the job." Hence, 
mentors could work with newly hired fully credentialed teachers to help 
upgrade their content knowledge, refine their instructional skills, and 
develop eff^^ctlve classroom management systans. Should a district 
elect to use teacher trainees, mentors would have a central role in 
managing a professional development program for these persons. 

Mentor teacher as "fellow" in teacher training academy . Another 
approach might be to group mentors in a teaching academy where teachers 
with particular expertise would constitute a "demonstration" school. 
Scheniey High School in Pittsburgh, Pennsylvania provides such an 
e:;<ample. This program provides a clinical teaching experience in a 
regular high school vhere teachers observe exemplary instructional 
activities, are able to practice ami receive feedback on instructional 
skills, and receive continued support for using new concepts, skills, 
and processes in their own instruction. 

^- M entor teacher ns "curriculum develop er''^ Finally, mentor teachers may 
be assigned to develop and install new curriculum materials. There is 
substantial evidence that the quality of textbooks and instructional 
materials has declined as students have Increasing diiflculty in 
reading materials "at grade level". In addition, there is frequently 
a mismatch between the classroom text. Instructional content and 
standardized tests* Thus, mentors might be designated to work in the 
summer or in noaifistructionai time to develop curriculum and assist in 
classroom-level implementation. 
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Attention to ligucs of mmlnatlon^ obaervatlon. and selection ^ California 
Education Code Section 44495 defines a nosainating process for selecting 
aentor caodldatea to te referred to the governing iKiard for designation* 
The aajority of the selection coulttee Is coaposed of dassroooi teachers, 
chcjen by other teachers, vlth the rraalnder of the coamittees composed of 
schs-%ol »4aiaiatrators« The selection coraalttee is direct^ to a>i^lder 
iovolviog parents t pupils, or other public representatlvea in the selection 
process. The selection process ii^ludes provisions for oteervation of 
dassrooQ tochers. The final designation of a j^rson as a mentor is 
by the district governing board* 

Districts have considerable flexibility to defins the criteria for 
oeotor teachers* The lav provides only that aentors: 

a. Be a credent ialed clas8ro<» teacher with permanent status (penianent 
status means tenure in those districts irtiich grant tenure or three 
years experience in districts which do not grant tenure) 

b. Has substantial recent experience in classrooa instruction 

Has deaonstrated exeaplary teaching ability, as indicated by, arong 
other things, effective coraainication skills, subject matter knowledge, 
and siastery of a range of teaching strategies necessary to xseet the 
needs of pupils in different context 

Support for mentor teachers in their new roles * Teaching adults is a 
significantly different process froa teaching children* Adult motivations, 
habits, attitudes, and skills are different from those of children and need 
to be accommodated in the training activity* Most mentors will be working 
as advisors to the teaching process # Hence, if the mentor is to observe 
and work with teachers in classrooms, the mentor needs expertise in observe* 
tlon, conferencing, and clinical teaching support. If the mentor lacks 
expertise in these areas, training mentor needs to be provided. 

Commitment from site administrators and teachers for work with 
the s^ntor Is essential* Mentor teachers are most likely to work with 
teachers at Individual school ^ltes« Observing in classrooms, sharing 
Instructional strategies, modeling teaching ideas; and providing resources 
wlil require a strong degree of trust among mentors and site teachers and 
admi nlstrators. 

Reasonable expectations about what mentors can accotsplish will also be 
eb^trntlal if mentors are to be well used. The law states that not less 
than 60 percent of mentor's time shall be spent in direct instruction of 
ptiplls^ but this doesn't preclude individuals from spending more or 
pv^n all of the time In direct Instruction of pupils, (e.g., the "training 
a» Hidemy'* notion). Further, if mentor teachers are to improve instructional 
quality, their duties must be thoughtfully planned in light of specific 
I'^ral needs and goals for improving curriculum and Instruction. 

Finally, provisions need to be made to ensure that mentors are 
Huppjrted in their new role as supervisors, not as evaluators. As partlcl- 
p.ir*ts in <i new activity, mentors will need to be given opportunities where 
thf'v i an share and improve upon their mentoring skills. 



Cqfrettt and future ^ar funding . The Legislature appropriated $i0»800,0OO 
for the Mentor Teacher Program for the aecotkl half of 1983-*84« Full funding of 
5 percent of the state's approximately 165^000 full-time certificated teachers 
Mould require $49,500,000 or $24,750,000 for half of a year. AB 70/1983 allowed 

State Superiateodeut to decrease the 5 perceiit peri^entage sulciplier to 
.ac commodate curreat funding levels and allow all interested districts to parti-- 
cipate if they choose, but at a reduced number of mentors (estimated to be 2 
{^rcent of the state's teachers)* TtiuSt mentors will ser^ only one half of the 
1983-84 school year ^and the state will apportion $2^000 per o^ntor for stipends. 

Section 26 of AB 70 defines district allowances for administrative costs of 
participating in the program. At least two-thirds of the funding is to be used 
for stipends; thus, each dlstrlct*s 1983-84 allocation of funds will reflect a 
2;1 relationship, with $1,000 of ^mloistrative cost funding for each $2»000 of 
stipend funding. 

Hentor stipends are not to be counted as salary or wages for purposes 
of calculating employer contribution rates or ^ployee benefits under the 
State Teacher* s Retirement System. Govemiog boaztl may designate mentor 
teachers for a period not to exceed three consecutive school years. Upon 
completing three years as a mentor teacher » an it^ividual may be reviewed 
and renominated. 

In summary^ The California Mentor Teacher Program Is an important initiative 
designed to upgrade the quality of instruction. The program provides an exciting 
opportunity to leeward excellence in teaching while implementing the reform 
mandate we have been given. This is a new program and as such^ we have few 
examples to follow for statewide implementation. Done carefully ^ with district 
needs and priorities driving the process, mentor teachers can make a powerful 
Impdct. Done poorly, the positive l^nefits of teachers helping other teachers 
may be lost In a cloud of minutiae. Thus^ we are doing what we can to tie the 
mentor teacher program to the broad reform agenda for public schools, and we 
urge you to do the same. 
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Teaching computer programming Is just as difficuit as te€K:hing mathe- 
matics or teachmg reading or any of the other di^iplines. We wcxjld not 
tolerate peqc^ who had ftad orm credit worth of reading or math toeing 
3 reading teacher or a math teacher So why do we tolerate people with 
that level of training being computer programming teacliers?" 

No matter how many computers we get, no matter tiow good the soft- 
ware gets, quality educatm Is going to depend on quality teachers. 
Educators looking to the future will need to put mmey Into hanJware 
and software, but they will also need to put a lot of money into teacher 
education if they're going to nave teachers who can take advantage of 
this hardware and software." 

Our educational system continues to stress a system of rote memoriza- 
tion, of developing skill and machine-like operations which a, a done with 
paper and pencil like dividing fractions. Is there anybody here who has 
^cund the need to divide one fraction by another by hand sometime this 

riqnt no'A computers are in short supply In education, and our thinking 
u/jut ojiTipui^jf'3 m education is inhibited by fears atxDut their expense, 
"^eir maintenance and the difficulty in leafmng lo use them. If all those 
'ears //ere resolved, the que.stion would be what difference would com- 
;;'u^,'r:> mdke m (jducation^" 
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MICROCUMfUTlK APPLICATIONS IN EUUCATION: NOW TO NEXT DECADE 



David (toursutid 
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University of Oregon 



Right now we are involved in a very massive change as far as 
education is concerned^ If you like chan^, if you like to 
involved in it, then you were born at the right time. &i the other 
hand» if participating in massive change bothers you, then you^re in 
for trouble. A Carnegie Commission Report, The Fou rt h Revo 1 u t i on , 
spQke about the four major revolutions In education: tne first was 
the inventio^i of reading and writing; the second was the concept that 
we would have schools and professional educators; tf« t' '♦•d was the 
Invention of the printing press; and the fourth revolution is going 
on nght now, the electronic revolution* 

There's a division, a very superficial one in some ways, but a 
division between the world of education and the world outside of 
education. And part of what IMl talk about today is the world 
outside of educduion because it gives a very good indication of where 
we might be headed within the world of education. If the difference 
between whdt's outside of education and what's inside of education 
qets, too large, then f^ople outside of education react in various 
ways. They start private schools or they put in a new school board 
or they vote down scnool taxes. 

Inside education, computers are starting to be available* In 
th*^ tjnited States the latest statistics suggest there's approximately 
one mTcroconiputer for every 125 students. The ratio in California 
might be closer to one microcomputer per 100 students. Let's suppose 
tnat one microcomputer per 100 students was reaHy used efficiently, 
jflffMr. ^o\j\(i that mean? If you schedule carefully, the average student 
mijjht ^et four ?ninutes of computer time a day— or if you're really 
sjper efficient, five minutes of computer time a day. 

di^'n^ ju^,t barely beginning in this field, but let's look at 
H^^it* y ^pt to happen over the next four or five years. Let's suppose 
y^j're a relatively poor school district of $2,000 per student per 
/*ear and for some reason you decided that computers and computer 
^.-^nnolj^jy weri^ important. Could you find one percent of your budget 
K'Ut into that year after yrar? If you put up $20 per student per 
r'ir -i^'i if you're Willing to settle for medium quality microcomputer 
s/7^*Mns, onp year's worth of money will give you a ratio of one 
'J., tM'n- :^^r SO '■^turit^nts, which is probably twice the California 
w^^'-ije. And if you do that a second year, you will have a ratio of 
,f{,* jK,r i^s Students iHfl if you kHf*p doincj that, it will lead you to 
i ^ r. j^. .ippro< 1 'natel y one machine per IS students--]f you're 
^ ' ^ i ' , I) ,'**tU' ''or that kinf! of 'nachuie. Of course your machines 
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stdrt to wedf out and you have to put up some money for maintenance 
and repair and so on* Whatever type of situation you're in right now, 
chances are you are noi^here near that fairly easily achievable goal 
of one machine per 15 students. 

If you're a slightly wealthier di strict » mayhe a S3,UU0 per 
student per year di strict » and you decide to put up one percent, how 
might you spend ^he $3U? Well you might spend S5 per student per 
year on teacher training . tou*re probably already putting that much 
money into teacher training. It could be scheduled for computer 
inservice. And you also probably i]r2d^y have five dollars per 
student per year for booKs^ films> and support materials. This could 
be used for computer books and support materials. The five dollars 
per student per year for software could be taken from the library 
funds. So it may be the case that to use $30 per student per year 
for computer education, you only need to find $15 per student per 
year that Isn't already there. 

The sense of direction of the cost of computing in education is 
that it very easily could reach the five percent level. Colleges and 
universities around the Uniterm States have started to gravitate 
toward the three percent solution or the four percent solution. A 
progressive school district may decide to go for the two percent 
solution. What could you do with a two percent solution? Well 
ruugtily speaking you can do twice as much as the one percent solution 
dnd lifter d number of years you might well end up with a ratio of 
dpproj< imately one machine for seven students, or 40 minutes per 
student per day on the machines. Now that starts to be enough to 
jTid<e a significant difference in education, 

Tht* point of this analysis is that It doesn't take huge amounts 
)f money. It takes one percent of your budget or two percent of your 
Dadget or something akin to that to begin to generate enough hard- 
•*ire, software, support materials, and resource people. This Is 
ruM^n*f1 if computers are going to make any difference in education. 
ji) r^t' ^uesLion then Decomes '^re computers going to make any differ- 
^nre education? What are computers doing and what can they do? 

1 *int to tdU a Ijttle bit about the world outside of education 
.md then I'll try to relate what's relevant to the business world to 
iwn^iVs relevant to the education world. First, IM! give a few 
exampW'S of commercial uses of the new technology. 



i'i* id'jcaLion: Robots » J^r i stwat ches and Laser Disks 

An article talking about the production of robots in the United 
?^'it^-s s^ys ft wiil t>e a 2bU million dollar business this year. Two 
'^iiOdred and fifty million dollars worth of robots. Robots costing in 
^^f> rjntjrf of $bu,UOU - $luO,OUU apiece. And each robot does the work 
)f '^eve^al human beings, A very crude rule of thumb would be one 
r.jUo^- ni'jht do the work of three to four people but require one 
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person to maintain It. So three or four jobs go away and one job 
gets eredte^. The job that fets created H <5«Ue different ffo« the 
jobs that go away. Does this have any Impact on educatlcm and what 
we're do:ng in education? It certainly scares some people. 

tend to think of a calculator as a siaple sinded thin^— It 
adds, subtracts, multiplies and divides. But I bought a calculator 
that had a little printer on it and it had a built in calendar so you 
could {wnch in any year and month and it would print out a calendar 
for that month. Our educational system has coped with calculators 
quite well. Jiamely it has ignored them almost completely. Nearly 
every adult owns and uses a calculator and seems to think it's 
perfectly appropriate to do so. Somehow or other if you're an adult 
you have done whatever you were re<|u1 red to do in school in the area 
of learning to do arithmetic and now as an adult you can do what 
seems most practical to you. &ut our educational system continues to 
stress a system of rote memorization, of developing skill and 
machine-like operations which are done with paper and pencil like 
long division of multl -digit numbers, computation of square n^ots, or 
dividing fractions. Is there anyb<»iy here who has found the n^pd to 
diylde one fraction by another by hand sometime this week? 

The wave of the future in terms of phonograph records is to have 
smaller records. There is a laser disk that stores music. This disk 
is somewhat less than five inches in diameter and holcis about one 
hour of music. It has a capacity for six billion bits of informa- 
tion. Now I want to try to translate that into something. Six 
oil lion bits is a way to encode one billion characters in capital 
letters and digits. And one billion characters is the equivalent of 
ore thousand 500 page novels. So we now have the technology to mass 
produce and sell cheaply a different medium for storing huge 
Iibrd"ies. One little disk which maybe sells for $10 could include 
the entire Encyclopedia Britannica and other huge encyclopedias as 
rfeii. A different way of storing and disseminating Information is 
f.ominq 'long, and that will affect education. 

There is a wrist watch on the market that hai a Spanish/English 
lictionary built in and also gives translations of 35 phrases from 
tfve different Wmguages. There is also a wristwatch that speaks 
when you push d button, and a camerd that tells ►you when you need to 
! Odd the film or if it's too dark or you're out of focus, ^tow this 
wristwatch that can talk and the wristwatch that can store the 
rlictiondry and the camera that can talk are things which can be 
•i'.etul learning aids. 

Inere is d commercial product from Xerox that has bui't-in 
(.wputer -dss i sted instruction. When you turn on the machine, a 
computer dutomdtical ly runs over 100 different checks on the 
circuitry to see whether all parts of the machinery are working 
ri jhu And if you've got some kind of a complicated copying job, you 
push the button thdt starts the computer program running which 
t'^dches you how to do the copying job. This computerized instruc- 
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tional system saves enough service calls and enougii training costs to 
be an economical way to proceed, in the past we nave tended to tnink 
of computer assisted Instruction first of aU as something that Is 
only going to ^ on In the school at^ secoml as too expensive, and 
this is a hint that both of those are wrong. 

If you walk into a research library the librarian will s^y we 
probably have the answer to whatever y<m want to ask. The direction 
of information retrieval, which is a very major part o.f what educa- 
tion IS about, is computerized Information retrieval systems. There 
are literally hundreds and hundr«is and hundreds of very large scale 
<Utd bank<i noM* In the business world it is very co^on to tie into 
these data banks. Education at tf» college-university level Is also 
doing this, but education at the pre-college level has not yet faced 
tnis issue. As leaders in education It's something that you'll need 
to face— the nature of libraries in terms of retrieval of information 
is changing. 



InsTde Education: Hardware, Software and Teacher Training 

What do you think a $795 computer will cost ten years from now 
or twenty years from now? It might be $50. Right now computers are 
in short supply in education, and our thinking about computers In 
education Is inhibited by fears about their expense, their main- 
tenance and the difficulty In learning to use them. If all those 
fears were resolved, the question would be what difference would 
computers make in education? One possible outcome of computers In 
education is that the schism between what goes on in the real world 
and what goes on 1n education will become broader and that even 
t^oij<jh oyery student has a computer. It won't affect the content and 
process of education. Another possibility is that education will 
become better and more relevant. 

Ihf heart of the matter over the long run is not going to be 
trifs hdrdware issue. This hardware issue is going to go away. 
Lv^.-ntudlly if we need and can appropriately use one computer per 
cniH, we wi!! have one computer per child. 

A second part of the question is the kind of software available 
for ^se. About two years ago I heard it said that 95% of what's out 
tne'-e is no yood. That means that five percent of the stuff that's 
o'jt there is pretty good. And there are lots and lots of researchers 
'r^inij T,o m^jKe better educational software. The most recent conment 
!s fhit jhout 8U percent of the software is no good and about 2U 
p»'f',».f)t IS OKiy. bo just in the last two years there's a tremendous 
^1 j^'j*'. 'jo t"/en though software is a major problem, the issue of 
v)t*.*ir^ 19 ijomtj to (jet to be less and less of an issue or problem. 

'hh fnird component is the teacher--the teacher's knowledge, 
,'■ :>, -ind ittitude. f<o matter how "iany computers we tjet, no matter 
)rt tne software qets, quality educ-ition is qoing to depend on 
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qudHty teachers. Educators looking to ttte future will need to put 
money into nardware and software, bu^ the^ will also need to put a 
lot of money Into teacher education \f tr^y're going to have teachers 
who can take advantage of this h&riiwire and software. 

The one percent m9f^\ tim we l^ed at had the very aodest $S 
per student per year put into teacher education as a starting point. 
Well let me tell you how to blow that ««iey and accomplish very 
little good. You take one of youp teacher inservlce days and you say 
one half of one day Is the computer Inservlce and you bring in 
sorneOody like fse to talk to all the teacfsrs in your district for two 
hours. And then you try to have all the teachers in your district 
touch a machine for five or ten minutes or iiaybe look at a siovie or 
something like that. What d<»s It cost to have a teacher in a half 
dd/ inservlce? U's pretty easy to see that you could blow $100 per 
teacher on a half day inservlce and that's what you'd accomplish with 
your teacher inservice «oney for one entire year. The question is as 
an administrator can you do something better with your money? 

Here is where the clever administrator really stands out. What 
you want to do 1$ to make significant progress on this teacher educa- 
tion problem without spending much money on it. What can you do with 
your $100 per teacher per year? Suppose that we don*t use the time 
when the teacher is getting paid. We tell the teachers there's a 
free course they can take in the evening. Now compare the cost of 
tndt--no matter what you pay the instructor—to the cost of using the 
inservlce time. Hot all teachers will buy it, but some of them will 
and you'!) save yourself a lot of money. You may then ask what can I 
do to entice teachers to come and take this free course? If you're 
puttttig computers In the schools, you might say that the people who 
attend workshops are the ones who get to have a computer in their 
t -jssroom. 

Each of you knows what you can do in your own building and in 
yo.if cwn school district. And each of you knows how to bend the 
rules !n order to get things done, and what we're asking is that you 
do then. 

Another thing you Cdn do with very little money is to set up a 
'.orner of the teachers* lounge with a few books and a few magazines.^ 
jjBscrioe to half a dozpn different computer publications and buy a 
few copies of Seymour Papert's book and just set them there. Maybe 
tPdchers wil) read them. Think about what it costs to buy one of 
r.nM'.P nooks or magaiines relative to the cost of paying the teacher 
*, ; r-.!.i 1-,. A vdridtion on this idea is to give the teacher a list 



' 'ne l ^rv)*?st computers -1n-educdt ion professional society is the 
'.nr^rn^t^onal Councii t )r Computers in Lducation, l/y/ A<jate Street. 

'irv'jon 9/4Ui. It publishes The Computing Teacher and many 
ooo'^pti for teachers. Write for a free catalog. 



285 



of tjooks ami say, "If ymi will agree to read this book, V\\ buy it 
for you." Tftat's a^very cHeap foria of teacher training. 

«hat kind of person <to you want to be the computer spedaHst In 
your elementary school or your secondary school? We may not have any 
choice right now since we're trying to. get started* He take the 
teacher who's most interested, who gets started, who's self taught. 
Bat our goal is to have the same level of c(^petence that we depend 
upon and require in every other discipline. And we have a long, long 
way to go, and we're not going to solve that problem by waiting for 
tne colleges and universities to produce all these high quality 
people Mho are going to do it for you. If you want stMnething reason- 
able to happen over the next five, ten, iS years it's mainly going to 
come from inservice education. As principals and superintendents, 
leaders m education, you know how to do inservite education. You 
icnow how to have it happen, so take it upon yourself to do something 
at>Oiit it. 

Let me give you an idea of what you might be aiming at. Let's 
describe some levels of an inservice model for computer education, 
rne goal of this inservice Is that all teachers should become 
computer literate, When we start to translate that into some sort of 
processes, the first activity is usually some kind of a workshop. 
The workshop is not having a guest speaker to all of the teachers in 
your district at one time. It is four hours of very carefully taught 
hands-on experience where teachers look at various pieces of computer 
equipment, use different pieces of software, do a little bit of 
reading, and begin to get some feeling that they can learn to do the 
s<jnie things that their students are learning to do. 

The second level in the inservice is for the teacher to know 
enough about computers to bring their students to level one 
(described in the above paragraph). Level one and level two are 
iiidyrje the most you can expect for the average inservice program. But 
tn's bdfi^ly scratching the surface, and every district ought to 
provide fit y her levels of opportunities such as three-credit courses, 
rtnat do you put in the first three-credit course for teachers? Level 
ofu' ind !eve! two did not have computer programming. Level three has 
'Offlputer programming as one-third of its content. The purpose of the 
.Qtnputer programming is not to produce someone to teach how to pro- 
'jrain computers. Teaching computer programming is just as difficult 
ds '•.ejchin<j mathematics or teaching reading or any of the other 
disciplines. We would not tolerate people who had had one credit 
rt^rtn of readimj or math being a reading teacher or a math teacher. 

t*t^■/ io we tolerate people with that level of training being 
u/ipitpf proyramming teachers? Tne purpose of level three is to yive 
-1 i»'-0'i(i 'jenerai overview of many of the thirvgs that we're talking 
jnoul tod^y and to yet teachers to start thinking about how computers 
i too! are going to begin to change the overall content of the 
. }i-i jn,i'i curriculum. We spefti a lot ot time teaching thinqs that 
' '■•;nt, n,)t bfi so appropriate any more. What we're aiming at in the 
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cotnputtny fieiO is to fully Integrate computers Into the curriculum 
in the same way thdt redding and «fr1t1ng Is a tool in every 
discipline, that math is a tool In many disciplines and ought to be a 
tool in more disciplines. 

Tne really big challenge is going to t>e to get teachers to the 
level «fhere they can begin to deal with this technology in their 
Curriculum and deal with changes In their curriculum that are 
dependent upon this technology, ^vlng an overview of c<mputers In 
education, learning to use a variety of software packages, learning 
to evaluate software, and developing some skill In using tte word 
processor and Information retrieval system turn out to be wore 
useful than learning to program in BASIC You can tell a high* 
quality teacher training course from a low-quality teacher training 
course almost entirely by whether It's mainly a computer programming 
course or mainly something else. 

The information age Is going to happen Independent of what the 
school systems do.^ How well we succeed is a very good measure of the 
quality of our educational leaders. Much of what has gone on In 
computers in education so far has been Individual teachers going out 
and learning on their own, often buying their own machine and using 
It In their own classroom. So if It's going to make some significant 
diff«>r«nce in education over the long run it's going to be because we 
hdve high quality leaders who will learn what they need to learn, and 
wno will do what needs to be done. 
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"Until the number of comfHJter-usir^ tethers in ttm varmis subjects 
increases suOstantiaHy, the market for software m those subjects is too 
imted to justify an investment in producing a. And, so lor^ asihe se/ec- 
tion of software is limited, many schools and teachers wilt be reluctant 
to use computers in their teaching." 

A new form of f^urphy's law: The program you want is OTily available 
for a machine you don't have." 

Schools can influence the future direction of growth in software by be- 
>r.g discriminating buyers. Buy only programs that give you the most for 
your money Insist on programs that can be used as tools by teachers 
'ind students programs that can be tailored to suit your curriculum:' 
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THE SOFTWARE PROBLEM 

Decker F. Walker 
School of Education 
Stanford tkilverslty 



When the time comes to use c(^puters for something beyond computer 
progranroing and computer literacy, the software probl^ 10(»jis. There 
seems to be a great deal of software: simply wading through all the 
titles searching for what you want can be a ddy's work. But try finding 
some software to teach exactly «^at you need taught and you will, at least 
nine times out of ten, encounter the software problem. 

Why is it so difficult to find good educational software? Is there 
anything a teacher or school at^lnlstrator can do to alleviate the 
problem? Is It likely to get better in a few years? These are the 
questions I will consider in this section. In considering than I will 
need to begin with the more basic Issue of how computers are used in 
schools. 



Computers in Schools: Varied Patterns of Use 

Computers can play a variety of roles In education, ranging from the 
most marginal of roles--as a supplementary optional activity for a few 
students, to the major role as a "ti»acher" of a course, ffech of the 
excitement about conputers in education is attached to the idea of the 
coiJ^)uter as a "teacher" in its om right— as a Socratic tutor, as a 
magnificent diagnostic device locating and remedying students' 
misunderstandings, or as the ultimate audio-visual device branching 
students through the Library of Congress on personalized learning paths. 
But the present reality is that computers play mainly a marginal role in 
schools except in computer programming and computer literacy classes and 
such vocational courses as typing, accounting, and electronics. 

The software problem is relatively mild in these applications bec2use 
tPdchers can use the software developed for more general purposes, such as 
operating systems, languages, word processors, accounting programs, and 
the like. But when we turn to important applications of computers to 
mdinstream academic courses such as English, mat'^, science, social studies 
and languages we find the software problem much more severe. We also 
find, and it is no coincidence, that use of computers as a major part of 
thp te<iching of thes*? academic subjects is quite rare today. 

Ihdt the software problem is most severe in mainline academic 
subjects is an important clue to some of the o.'igins of the problem. In 
"hose educational applications where computers are now being widely used — 
coniputer literacy, programming, vocational appl ications--generally only a 
sinqle piece of software is needed, an operating system, a language, or a 
wor^i processor. In the teaching of an academic subject like algebra, 
hi)WHv<'r, pprndps ds many as a dozer or more substantial programs will be 
nMf'jM'i if the computer is to be useful over the entire cou'"5e. If we 
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multiply the number of subjects taught (perhaps an average of 8 per year) 
by the number of grade levels (12) by the number of programs needed per 
course {say 10) we see that nearly 1,000 programs are needed simply to 
cover the public school academic curriculum with only one program per 
topic. 

So, even though software seems to be flooding the market— our files 
at Stanford include over 100 catalogs of educational software with more 
than 3,000 titles— coverage of the software needs in academic subjects 
remains spotty. When you consider that most of the Items In the catalogs 
are concentrated In a few subjects and topics (eleir^ntary math drill and 
practice, spelling, and computer literacy). It Is easy to appreciate the 
enormous variety of the demand for software. This variety means that the 
market for any single piece of software filling only one of these 
thousands of niches will be smaller than the market for more generally 
useable programs. Until the nus^r of c«nputer-us1ng teachers In the 
various subjects Increases substantially, the market for software In those 
subjects is too limited to justify an Investment In producing it. And, so 
long as the selection of software Is limited, many schools and teachers 
will be reluctant to use computers in their teaching. This is the 
familiar Catch 22 situation that confronts any innovation, but the 
fragmentation of the market into so many niches makes the problem more 
severe in the case of substantial applications of ccmputers to mainline 
academic subjects. 



Go od Educatiorfa] Software 

Computers have been called "chameleons in the classroom" because they 
can be used in so many different ways. Cwnputers used for drill and 
practice with individual students seem so different from the machines used 
as an "electronic blackboard" to present animated geometry diagrams or 
from the machines used by a small group of students in a simulation game. 
The differences are produced by the software: the computer may well be the 
same machine in all these applications. 

The qualities that make a computer work well for one of these 
educational uses may not necessarily be desirable in the others. And this 
IS another source of the software problem: varied criteria. A piece of 
software that does a good job of teaching arithmetic facts through drill 
and practice will not satisfy educators who want programs that develop 
understanding of number concepts, A program that entertains and motivates 
students with color graphics and animation will please those whose 
educational philosophy is child-centered and displease those whose 
philosophy Is more subject-centered. Such diversity of criteria further 
reduces the lllcelihood of finding software that will be generally regarded 
as qood and increases the number of niches in an already fragmented 
market , 

f-inally. we must recognize how high are the standards typi'.ally used 
to judge educational software. Few dispute that computer programs can 
teach number facts, but we also know that traditional methods such as 
flashcards, can do the same job and much more cheaply. Cranputers, being 
morn r.ostly, must accomplish more than traditional methods if their use Is 
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to be justified econcHnical ly. By extension of this line of reasoning, 
ways must be found to use computers to teach the most difficult concepts 
and si(>111s, those iii^lch substantial numbers of children now fail to learn 
using traditional methods. To develop prograois that achieve these high 
standards is not an easy task. We certainly cannot exf^t that snyfXie 
should be able simply to sit down and write such programs. They require 
thorough analysis, deep thought, and inspired design. 



Current Dimensions of the Software Problea 

The fundamental problem is a shortage of educational software that 
can be used as a major part of the teaching of academic subjects in 
elementary and secondary schools. The number and variety of programs 
needed to alleviate this shortage is large, but, as the saying goes, "you 
ain't seen nothin* yet." We have yet to consider several other aspects of 
the problem that make it larger and nrore severe than it seems so far. The 
aspects that follow are presented In no particular order. 

1. Development time and cost . The best estimates of the time 
required to design and code a computer program range from 100 to 300 hours 
per hour of running time. This does not Include the time needed to think 
up the program ideas. Th^s translates into a development cost for a 
program that students mignt use for one hour of between $2,000 and 
$100,000, depending on its sophistication and complexity. By contrast, to 
produce text material to occupy a student for an hour is a matter of a few 
hundred dollars at most. And remember that the market for the software is 
limited by the number of machines available and the large number of small 
niches in the market, much greater limitations than apply to text 
materials. 

2. Machine incompatibility . A new form of f^rphy's law: The program 
you want Is only available for a machine you don't have. 

3. Software piracy . Software manufacturers are reluctant to invest 
in the development of products that will be copied at no charge by the 
customer. If one can sell only one copy of a program per school, the 
price necessary to recover the investment must be large, between $300 and 
$500 per copy. This, obviously, makes It prohibitively expensive for a 
school to buy enough copies to supply one for each computer and therefore 
ensures either that the software will only be used as a supplement or that 
It will be Illegally copied. 

^' L ocati ng and revi ewing software . Ev:*n when good software exists, 
findiny ft and veri"fying"~that it is good are nontrivial problems. Indexes 
are beginning to appear that list software by subject, grade, and other 
useful properties, but at r-iis moment coverage of such indexes Is spotty. 
A number of journals publish reviews of software, but finding a review of 
the program you have in mind remains difficult. What we need are 
specialized publications dhat review programs in a small area with 
particular reference to their i*':ful less in ihe classroom. Again, we are 
confronted with the probleir of a plethora of small niches which make it 
tjneconomic to provide reviews to Such a small audience. 
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5. Coffip%.£Ujon for the hoae^rket, rather than the school . The 
nufBber of installed machines in imtes far exceeds the nuint»er in schools, 
and individuals buy a total dollar voluine of software several times 
greater than schools. Software manufacturers can therefore sell to a 
]ar^r raarket by producing for the home* And mo%t of th^ do. This means 
that software is designed primarily for conditions in the hoii»— one 
student per computer, unsupervised use, episodic use with little extended 
continuity in the development of skills and ideas. 

6. Problems in integrating software into the classroom's other 
activities . Even a well-designed piece of software will not fit exactly 
into a given teacher's plans. Adjustments mst made to accommodate it. 
If the software Is not modifiable, then all the adjustments must be made 
elsewhere, and there are limits to a teacher's willingness to tailor 
everything else to one program. And when a teacher uses several programs 
in the course of a year, each of which requires a different set of 
adjustments, the problem may become insunmiuntable. Examples include the 
spelling program whose words do not match the teacher's goals, the math 
program which introduces skills in a different sequence from the school's 
curriculum, and the science program which uses a different notation from 
that in the textbook. 

An these difficulties translate into a higher cost to provide the 
software needed. The cost of equipping a single course in one school with 
enough software to be used one hour per week for 30 weeks in a school 
year, assuming appropriate programs were available at today's typical 
price of $50 per diskette, and an optimistic 'playing time' of three hours 
per diskette, and one diskette for each three students in a thirty-student 
class, ccifies to $5,000. This figure Is too expensive by a factor of ten. 
So long as costs are this high, the market in schools will be thin. 
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What To Do ? 

What can be done today to overcome the software problem? The 
software problem manifests Itself as an economic problem, even though not 
all of its causes are economic. The home market for educational software 
programs will likely continue to be bigger and richer than the school 
market, and therefore software companies will continue to produce for that 
market. Eventually, competition for that market will make the smaller 
riches In the school market relatively more attractive, and we will then 
see more production of software specifically for schools. In the 
meantime, however, fie home market Is far from saturated, so the present 
situation Is likely to continue for some time. 

Only large-scale actions would change this economic situation 
substantially. If the government and private foundations could be 
persuaded to finance dozens of software projects In education, that would 
make a dent in the problem. If districts formed consortia and Invested 
their own funds In the development of software, that would have a 
si gnlf leant impact. Million dollar contracts between software development 
houses and school districts to develop software collaboratively and f lare 
royalties would have an effect. And the simple growth of a school market 
for software will, in itself, stimulate more and better software. 
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Progress In this fundamental aspect of the problem requires growth of 
tnvestreent or expemlttures or bofh. If this growth fails to come or comes 
slowly, the software problem will not Improve, regardless of anybody's 
good intentions or hard work. 

In the present thin market, buyers' decisions have an Iswedlate and 
powerful shaping effect on producers. Those products that sell will be 
widely imitated, while those that do not will rapidly disappear from the 
catalogs. Schools can Influence the future direction of growth 1n 
software by being discriminating buyers. Buy only programs that give you 
the most for your money. One measure of the value of a piece of software 
is the number of student -hours of use per dollar of cost. This figure 
ought to be computed in reviews of software prior to every purchase. 
Another important quantitative indicator is the extent of your curriculum 
covered by a program. One that Is useful in only 1% of a year's classes 
is less valuable than one useful in 10% of classes. 

What actions can an individual school or district take to cope with 
the software problem? One thing that should be done is old-fashioned 
curriculwn development. Sco}^ and sequence charts are needed showing just 
where what types of conputer programs can be used and teacher's guides 
showing how they can be integrated with the other Ingredients of a good 
course. 

The problem can be eased by extensive use of tool -type programs and 
modifiable programs. The Music Construction Set is a program that 
transformi a computer into a composer's typewriter. A staff and various 
symbols ire displayed on the screen and these can be moved around with 
keyboar-j commands or a light pen to compose music which can then be played 
by the computer with the press of a button. Such a program can be used 
throughout the year in a music class. A spelling program which permits 
teachers to enter their own words is much more valuable than one with a 
fixed wrd list. Insist on programs that can be used as tools by teachers 
and students, programs that can be tailored to suit your curriculum. 

One type of educational software that is little known in this country 
but widely discussed in Europe and Japan can be used to great effect in 
dCddemic classrooms. These programs are called "electronic blackboard" 
programs. One such program. Quadrilaterals, is published by Reader's 
Digest. A teacher uses this program on a single computer at the front of 
the classroom, with a screen large enough for all students to see. Using 
game paddles, the teacher is free to walk around the room while 
controlling the display. The teacher can choose to have text displayed or 
only diagrams. (Ajestions can be posed for class discussion and then the 
animation powers of the program used to show the answer on the diagrams. 
The program is used very much like a chalkboard by the teacher, so that no 
extensive inservice is necessary to prepare teacht." to use it. Such 
programs can be extremely cost-effective ways to use canputers in the 
teaching of academic subjects. 

Teachers can create their own educational software. To do this 'from 
scratch' in Basic or assembly language is a difficult and time-consuming 
activity that cannot be expected from teachers working full time. But, 
using an authoring system such as Pilot, teachers can develop lessons in 
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only slightly more time than It takes to develop ditto masters or overhead 
projection sheets. However, to develop software that is truly interactive 
and that accomplishes things conventional i^thods cannot remains a high 
art, difficult and time-consuming. It might be reasonable to expect a 
talented, dedicated teact^r working with an authoring system after school, 
weekends, and holidays, to produce two or three hours' worth of such 
programs In the course of a year, but not more. Unless your school has an 
unusual concentrat1<^ of these rare birds. It Is unwise to rely upon 
teacher-made computer software for a major part of your courseware. If 
you are determined to rely on teacher-macte software, you might consider 
contracting with the most able teacher -developers to spend a substantial 
portion of their time for a year or so developing software. You might 
even consider entering Into a consortium with neighboring districts to 
pool the talents of your teacher-developers. 

It Is {H}ss1ble to lease or purchase a complete set of integrated 
software designed for school use. taputer Curriculum Corporation, for 
example, has complete cwnputer-admlnlstered courses in irost of the 
subjects of elefl^ntary and secondary schools. Many publishers of basal 
texts for the elementary school also offer computer software designed to 
accompany and enhance their text materials. Control Data Corporation's 
PLATO systeiD offers a good selection of software for most school subjects. 
These integrated software systems are expensive, and they are not 
tailorable to an individual school's or teacher's needs, but they may be 
more cost-effective than assembling your ow) software from cataloos or 
developing teacher-made materials in many Instances. 

Over a somewhat longer period and on a larger scale, you might 
contemplate entering into collaborative arrangements with software 
developers to work on the most pressing software development needs. 
Consortia of districts contracting with private developers and Involving 
local teachers In the development process can be a powerful development 
strategy. Collaboration is also possible with professional associations. 
Such initiatives put your school Into the software development business 
dnd this might be difficult to arrange with your board, but they give you 
more control Over the software than you get any other way. 

In summary, the software problem is serious and can be traced to some 
fundamental economic causes that are not easily overcome, but there are 
'constructive ways to cope with the problem if you are willing and able to 
invest the money, time, energy, and initiative. The problem will not go 
away in the foreseeable future, in any event, and it will only get 
substantially better az more organizations invest more in developing good 
i.'d " i onal software. 



"Widening the gap 6efween f^jose Vr -^o - <dve techrK)togkial competence 
and those who cto nof ft;rr/7er limits the learning potential of those wlyo 
fail to gain techmtogical expertise. The inequitable distribution of com- 
puter learning experiences is already a serious problem; steps must be 
taken to alleviate it" 



' A major impediment to effective use of computers in schools is the lack 
of curricula which incorporate computer-based activities. When soft- 
ware is available it is rarely incorporated into a curriculum:' 

Computer learning environments have the potential for fostering higher 
cognitive skills including strategic planning skills and debugging skills." 
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THE GAP BETWEEN TOOMISE AND REAtlTY- IN CWIPITFR EDUCATION: 

PLANNING A RESPONSE 

W. C. Linn 
University of California, Berkeley 

C. W. Fisher 
Far West Laboratory 



The current gap between the promise of computers In schools and 
the reality of their use In classrooms Is simply too great. Before 
a national magazine heralds the trend with a cover story such as 
"Macro Expectations, Micro Outcomes: Computers Fall School," a con- 
certed effort Is needed to change the situation. Computer education 
can and should live up to many of the promises which have i^n made. 

In this paper we identify several reasons for this "gap" and 
discuss factors schools might consider in planning programs which 
will bring con^uter education closer to the envisiof^d promise of 
computers in schools. We focus on the instructional uses of com- 
puters rather than on the managerial and other supporting uses also 
prevalent in scfwols today. The gap between the possible Instruc- 
tional uses of computers in education and their actual use results 
from a variety of reasons, many of them completely beyond the con- 
trol of schools. In this paper, we focus on factors within the 
control of schools and reflected In school-based decision making. 
We draw on experiences that schools have had using Innovative pro- 
grams, on investigations conducted by research groups, and on in- 
sights shared by thoughtful teachers. We suggest how schools can 
use what is known about computers in education to design progra-ns 
to meet their needs. 



Project ACCCEL 

The Assessing the Cognitive Consequences of Computer Environ- 
ments for Learning (ACCCEL) project, in a series of investigations 
conducted at the Lawrence Hall of Science and the Far West Laboratory, 
seeks ways to increase the effectiveness of computers in schools. 
This project, funded by the National Institute of'Education, is 
evaluating the cognitive consequences of computer-based experiences 
on students and has focused primarily on examining experiences 
which have the greatest potenti»»l for influencing student cognitive 
performance. (Additional information about the ACCCEL program is 
available fron the authors.) The preliminary investigations of the 
ACC(-{:i project offer the beginnings of a model of computer-based 
instruction. 
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The ProTTilse of Coiripyter learning Environnients 

Promises have been nade for ctriputer learning environnents be- 
i^tise of their ^reat potential fo*^ fostering high.^r cognitive f:kms. 
♦ 's the Aii/tl project ha: clarified^ and Is dilscussed further below, 

i^'.,tprs r)r tosN^r sMlls such js plannfnt; probleni solutions an>! 
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debugging the proposed plan. Schools frequently point out that they 
wish to teach these skills. 

A variety of national comfflsslons, st^h as t)» National Cosoils- ° 
slon on Excellence In £dtKat1on and the national Science Board, have 
recently drawn attention to the deplorable state of education In our 
nation's schools and have called for educational Innovations which 
encourage these skills variously referre<1 *jo as the "new basics/ 
problem solving and a "learning society. If used effectively, com- 
puter learning environments have potential for responding to this 
call. 

The coBiputer is a tool like the printing press or the pencil. 
The potential uses of the tool are great. However, serious effort 
and st^stantial resources are needed to design programs and train 
people who can capitalize on the potential of the tool. Six key 
features of the computer learning environment distinguish it from 
other learning environments and make It an exceptional facilitator 
for the acquisition of cognitive skills: (a) interactiveness, (b) 
precision, (c) consistency, (d) challenge, (e) complexity* and Cf) 
provision for multiple solutions. Each of these features is exam- 
ined in turn. 

First, computer learning environments are interactive. Whether 
one is using a conputer simulation, playing a computer game, or de- 
veloping a computer program, there is a cyclical process of providing 
Information to and receiving feedback from the computer. Although 
the time required for the response-feedback cycle can vary greatly, 
all computer learning environments are characterized by Interactive- 
ness. To proceed with any computer task, the learner roust respond 
actively. That is, the learner must submit another program. Initiate 
another keystroke, or move the paddle control. The requirement that 
the learner respond periodically (usually very quickly) Insures some 
level of cognitive activity. 

The quality of the cognitive activity generated in computer 
learning environments is dependent upon the software or programming 
task that is used. Although Interactiveness is not unique to com- 
puter learning environments, the degree to wh^ch computer-learner 
interactions can be controlled and potentially used for increasing 
learning efficiency is an important characteristic of ctmiputer learn- 
ing environments. In addition, computer learning environments are 
far more likely to provide rapid feedback than ere other classroom 
environnents where assignments may be returned days or weeks after. 

Second, the computer learning environment is precis*. To com- 
municate with the machine, the learner must specify his message com- 
pletely. In gefwral, the computer does not ma* * inferences, read 
bebKeen the lines," or otherwise use implicit knowledge to interpret 
the desires of the learner. This explicitness requires the learner 
to differentiate among items that previously were undifferentiated, 
or to "think through" aspects of a problem that previously were un- 
clear, and to give relatively complete specification of messages. 
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Thus, th« preclseness of coinputer learning environments encourages 
students to be precise. 

The computer response can also be precise If properly program- 
med. The precise Information provided In program <tebugg1ng often 
exceeds that In other learning environments. Rather than just say- 
ing an effort to solve a problem Is wrong, tJie craputer can diagnose 
some aspects of what might be wrong. 

Third, computer learning environments are consistent. This 
consistency 1$ manifested In several ways. If the learner provides 
Information to the computer (In the form of a program, or a series 
of keystrokes), the computer will respond In a specific and concrete 
nanner.r If the learner repeats his action {resubmits the program 
or repeats the same series of keystrokes), the computer will give 
the exact same response. If the learner does the same thing, the 
computer will do the same thing. 

The computer learning envlrorenent is consistent in a second 
important way. The computer will provide a consistent response (to 
the same input) regardless of i^o the learner/programmer Is. An 
obese or a thin person, a tall or short person, a native English- 
speaker or a native Spanish-speaker, a black-skinned or brown- 
skinned person, all will get the same i*esponse from the computer, 
provided the same information was "fed In." That Is, the feedback 
provided to learners does not vary with "irrelevant" characteristics 
of the learner. These, more or less obvious, points about the con- 
sistency of the computer learning environiwnts have important impli- 
cations for what and how much students learn since the feedback 
should be easier to identify, compared to other environronts where 
the feedback is less than consistent. Consistent feedback can maVe 
learning efficient. 

Fourth, the computer provides a challenging and motivating en- 
vironment in which to learn. Many teachers have observed the moti- 
vational qualities of the computer in the classroom. Proponents of 
the use of games and simulations in learning environnwnts state that 
games are good problem-solving envirorenents that stimulate explana- 
tion, discovery learning, and formulation of strategies. 

Fifth, computer learning environments are canplex. Computers, 
computer systems, and software are multi-functional in their opera- 
tion. This complexity can encourage or require higher cognitive 
processing. For example, the computer can require the learner to 
build a conceptual representation {mental model) of its operation 
in order to solve problems. The process of building a mental model 
requires several important cognitive skills. First, one must be 
able to organize many detailed, low-level facts into a coherent 
knowledge structure. Second, one must predict the operation of the 
computer on the basis of the model. This entails accessing one's 
knowledge representation in the act of writing a program. Third, 
one must compare the predicted with actual outcome?. Sometimes, 
such comparisons require interpretation of empirical evidence. 
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Fourth, one nust dlAgnose the cause of discrepancies betweeit expect- 
ed and actual outcomes. Lastly, one must refine one's knowledge so 
that the laental sodel Is consistent with the actual system. This 
process is interactive In nature. In that the cycle of prediction, 
testing, and refinement is repeated imtil an accurate aodel is con- 
structed. Coopared to other approaches, the cfNnputer provides a 
safo, cheap, and fast environment for learning a coi^lex system 
{e.g., compare to costs of experinenting with nuclear reactors^. 

Sixth, cor^>uter learning env1rone«nts provide for tl^ presenta* 
tion of problems to learners that have nany correct solutions. Mul- 
tiple solutions encourage divergent thinking, creative approaches 
to probletn solving. Individual expression and style, consideration 
of varied alternatives, and subjective Judgment of appropriateness 
and elegance. 

Schools can capitalize on these six features of the con^uter 
learning environnent to foster higher cognitive skills, to achieve 
affective outcomes, to Increase equity of educational opportwi ty, 
and to design effective teacher professional developn»nt programs. 
The computer provides a unique tool for schools; planning is re- 
quired to Riaximije its power. Using computers as smart typewriters 
or as automated flash cards, while helpful, fails to take advantage 
of their full potential. 



T aking Advantage of the Computer Environment: School- 
Based Decision Making About Computer Education 

In the area of computer education, schools frequently find that 
realistic planning is, at best, frustrating. Even after expending 
much effort at the school and the district level, programs frequently 
appear haphazard or unsuccessful. iR^edlnwnts to effective planning 
for computer education include U) lack of control of harAuare deci- 
sions, (b) lack of available, effective software to accomplish the 
desired objectives of computer education programs, (c) lack of cur- 
ricula which Incorporate computer-based activities, and (d) lack of 
appropriate tralninq for program implementers. 

Although few school districts have been able or willing to de- 
sign long-range strategic plans which Incorporate what Is known about 
computers into a program which can maximize the outcomes from com- 
puter education, the opportunity exists. Before we find that com- 
puters have been placed In closets and are collecting dust, we need 
to capitalize on what we do know about computers In education. By 
maximizing the effectiveness of existing programs, we can narrow the 
gap between promise and reality 1n computer education. 



Hardware Selection 

Many factors contribute to haphazard planning In schools. A 
largo number of these factors are absolutely beyond the control of 
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those nak1n9 %t\e decisions In schools. For exas^le, computer hard- 
ware Is frequently donated by Industry, by parent groups, and by 
business consortia. Sometlo^s schools are simply not consul teu 
about these decisions before the hardware arrives. Funding of com- 
puter education ^ogrsiis Is often impredlctable. State programs 
for cMi^uter education may suddenly emr^e and equally suddenly be 
discontinued. The federal govenraent has Increased and decreased 
funding for a variety of programs that directly and Indirectly In- 
fluence computer-based learning experiences such as equity programs, 
vocational Gaining programs, and programs for ^e learning disabled. 

The "buy now, plan later" approach to hardware selection fre- 
quently appears to be unavoidable, nevertheless, districts which 
buy computer hardware now and come up with an Instructional plan 
later are likely to widen the gap between- the promise of computers 
in education and the reality of their use In the classroom. Plan- 
ning fs necessary for equitable and exciting outcomes from ct^uter- 
based Instructional programs. Haphazard approaches to ccsnputer-based 
Instruction result In haphazard outcoi%s and leave schools open to 
severe criticism about the effectiveness of the^r c(»qjuter-based 
instructional program. 

A misplaced perception that "If you don't have a product for 
your expenditures, you're wasting your money," may permeate sme of 
the decision making about Instructional programs using computers. 
Districts may purchase hardware before adequate planning for appro- 
priate teacher training because hardware results In a physical pro- 
duct which can be shown to the school board, visiting parents, and 
other concerned individuals. In the long run, the presence of hard- 
ware in schools '•ould become a point of end)arrassment rather than a 
point of pride. Before such a situation emerges, planning for effec- 
tive outcomes from computer-based learning environments is required. 

Schools often have the opportunity to influence the hardware 
selection process. Now that numerous districts have computers, it 
is possible to learn from the experiences of others. Clearly, 
schools will make more effective decisions If they have some idea 
about what they want the hardware to do for them, hence the need 
for planning. On the other hand, as discussed below, the potential 
uses of computers have not been fully explored so schools can expect 
to modify their plans frequently as new information en«rges and as 
they learn more about the skills of their teachers and the capabil- • 
ities of their students. Planning for effective nardware selection 
requires on-going information gathering and flexible adaptation to 
new situations. 



Software Selection 

Software selection is intertwined with hardware selection since 
educational software is often hardware-dependent. On-going decision 
making about software selection is especially important for effective 
cof^puter education. New products appear on the market constantly. 
A major impediment to effective software selection is lack of infor- 
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nation abmit nen developiaents. Several factors contribute to thfs 
situation. 

First, the dissemination of Infomatlon about educational soft- 
ware Is poorly establlst^. It Is difficult for schools to find out 
about new products and freqi^ntly the only source of Information Is 
a salesperson for a particular prodwt rather than a netiRirk or con- 
sortium of Individuals who have reviewed the range of products. The 
sales people who generally provide Information about Innovation In 
the field of computer education have vested Interests In selling 
their own products. A few groups such as C08q)uter Using Educators 
(CUE) offer regional conferences where Infonratlon can be shared. 
It should be noted, however, that school district budgets do not al- 
ways provide funds for teachers to attend si^h conferences. Swne 
states have technical centers which gather Infomatlon. and several 
clearinghouses for educational softiare are now emerging, such as 
EPIE, funded by the National Institute of Education and located In 
New York, and the Minnesota Educational Computing Consortium (HECC), 
but more coflH>reten$1ve efforts are needed. 

Second, teachers have not yet developed the ability to browse 
through educational software In order to select software which will 
meet their needs. Over the years we have develc^d techniques for 
browsing through books. However, browsing through software requires 
a different set of skills and Is frequently quite Ineffective. For 
example. Rocky 's Boots, a program which many teachers feel Is one 
of the best examples of a learning environment which demands stra- 
tegic planning and debugging. Is frequently rated poorly by teachers 
who are given only a short period of time to examine the software. 
This situation results because teachers have difficulty In distin- 
guishing the cognitive learning features of the software from the 
logistic features. One Important aspect of teacher/professional 
development must be training on criteria which are appropriate for 
making software selection. 

Third, relatively little software has been developed for the 
educational market when con^ared to the entertainment market. Fur- 
thermore, educational software Is frequently targeted to the home 
rather than to the school, largely because the education market Is 
thfn and unpredictable and because dissemination to schools Is 
difficult. 

Much more cognltlvely Interesting and demanding software Is 
needed in order for schools to be able to capitalize on the computer 
learning envirormient. Given the dearth of such software, schools 
are teaching progranmiing more frequently than they probably would if 
other software were available which stressed problem-solving skills. 
Progranmting has the advantage of providing the problem-solving op- 
portunities and the disadvantage of not emphasizing subject matter 
for a specific course. Ultimately, cognltlvely Interesting software 
for computer-based learning envlroiffiients will emphasize problem 
solving using the subject matter in the particular course for which 
the software is used. 
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Fourth, distribution of software to schools is difficult. At 
the present time, textbook com^nles have the major network for dis- 
tributing Information to schools. When textbook companies do select 
software for distribution, they freqt^ntly stake the sane sorts of 
errors which are isade by others unf^^iliar with browsing through 
software. They select software which looks o^re like books and is 
less likely to take advantage of the potential of a computer learn- 
ing situ&tion. 

Fifth, schools often select software because It is inexpensive 
or free at a softiare exchange rather than because It is the best. 
Such decision making discourages software developers. The best 
software takes years to develop and requires much evaluation and 
revision. Quickly developed tools freqi«ntly feature either drill 
and practice or display of information. These programs often fail 
to use the computer envirofwient to its full rotential and ultimately 
convince observers that the cwnputer is not effective for schools. 

These factors work together to discourage the selection of ef- 
fective educational software. Since distribution networks are poorly 
developed, manufacturers are not motivated to develop products for 
the educational market. Since selection of software requires train- 
ing and experience and since Information about software is difficult 
to acquire, schools are tempted to make haphazard decisions. 

Computer Curricula 

A najor impediment to effective use of computers in schools is 
the lack of curricula which incorporate computer-based activities. 
When software is available It is rarely Incorporated into a curri- 
culum. An exception is the Creative Play curriculian for upper ele- 
mentary school available from the Lawrence Hall of Science, Berkeley, 
CA. 

When curricula are available they often emphasize drill and 
practice rather than the higher cognitive skills which computers are 
capable of exercising (as discussed in the next section). Very few 
textbooks emphasize the higher order probl em-sol vir.g skills which 
naice the computer learning environment especially effective. Indeed, 
explicit instructions for higher cognitive skills such as planning 
and debuqging programs are frequently lackinq in curriculum mater- 
ials, even curriculum materials for programming taught in colleges. 
A recent survey of textbooks for college use reveals that less than 
one percent of textbook pages are devoted to debugging, an activity 
which freqi^ntly comprises 50 percent of a programmer's time. Thus, 
curriculum materials have not adequately responded to the nature of 
the computer learning envirofsnent. The lack of effective curriculum 
materials greatly inhibits the possibility of making effective use of 
this environment. 

lack of effective curricula for computer education places major 
responsibility on school-based decision makers for selecting software 
to complement the educational program. Evei if schools have decided 
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*#hat they want the coraputer education progra«» to accwpUsh, they 
have difficulty ensuring that the aatepials they select win do the 
job. 



Staff Training 

The lack of appropriate training for program Implantation Is 
another Impediment to successful operation of computer-based instruc- 
tional programs. The time required for teachers to develop their own 
computer skills is often underestimated. Since most schools have be- 
gun to Implement instruction In computer prografmiing, there has been 
considerable demand far programming Instructors. In many cases, staff 
for programming courses coise from the ranks of experienced classroom 
teachers who have little previous experience In progranmlng. It is 
not unusual for prograimsing Instructors In some schools to have only 
six months of programming exf^rlence when they begin to teach program- 
ming. The time and support required to provide appropriate training 
for instructors present educational decision makers with some diffi- 
cult problems. Since schools are under considerable presstre to pro- 
vide programming Instruction, they must respond relatively quickly, 
often before they have had tin^ to develop and Implement high quality 
training procedures for the prografamlng Instructors. Two factors 
prevent schools from attracting competent programmers to teaching 
from other sectors of the economy. First, competent programmers 
have higher Income levels than teachers. In fact, the schools may 
be in some danger of losing their best programming teachers to more 
high-paying jobs outside of school. Second, the schools are, in 
many cases, looking for new instructional areas like programming to 
absorb experienced teachers who have been displaced by lower enroll- 
nients and school closings. 

Although the training of programming instructors poses a prob- 
lem for schools, this problem is not insurmountable since it involves 
a relatively small number of teachers. A larger and more serious 
problem arises when we consider the integration of computer-based 
activities into the mainstream of the school curriculum. If schools 
are to take advantage of the computer learning environwnt by incor- 
poratiHs; computer-based simulations and other activities {other than 
programming per se) in reading, writing, Mthematics, science, social 
studies, and art instruction, then some computer-related training 
will be required by the vast majority of practicing teachers and 
virtually all prospective teachers. The sheer numbers of people to 
be trained and the great diversity in the applications that teachers 
fii^] have to be familiar with, make the staff development effort 
very conplex. The general issue of staff training has wide ranging 
implications for vhe scope and sequence of any computer-based in- 
struction and should be one of the major considerations in program 
plannin'5 . 



School-Based Planning for Coisputer Decision Waking 



There is no question about the difficulty of school-based plan- 
ning for computer education. The gap between pronlse and reality In 
cosqjuter edwzatlon stems from mny factors which sake planning diffi- 
cult. Nevertheless, experiences of sclwols using conputers, research 
on computer learning envlroments. and reflections of expert teachers 
offer Insight Into four tsajor questions facing school-based planners. 
These questions are listed In Table 1 and discussed subsequently. 



Table 1 

School-Based Computer Education Decision Making : 
questions to Consider 

1. What cognitive outcoines from cwtputer education programs are 
possible and (teslred? 

2. What affective outconws are possible and desired? 

3. How can equitable access to computers be ensured? 

4. HoM can professional staff development be fostered? 



Planning for Cognitive Outcomes 

Computer learning envlronnients have the potential for fostering 
higher cognitive skills Including strategic planning skills and de- 
bugging skills. By strategic planning we mean the ability to combine 
diverse pieces of information to generate a unique problem solution; 
by debugging we mean the ability to diagnose and remediate difficul- 
ties in a strategic plan. These skills are objectives of most edu- 
cational programs, yet, the difficulty of teaching them often results 
in only token consideration In curriculum efforts. Computer environ- 
ments tor learning can greatly intensify the opportunl^ to focus on 
strategic planning and debugging In educational programs. 

Although strategic planning and debugging are the ultimate ob- 
jectives of a large number of computer-based learning programs, fre- 
quently the programs are neither long enough nor intensive enough to 
achieve these consequences. On the other hand, nany programs involve 
drill and practice nther than these more complex activities. Pro- 
grams which emphasize drill and practice often fail to focus on any 
hiqhcr cognitive skills. 

It is possible to define a chain of cognitive consequences from 
the direct outcomes of initial computer activities to more general 
strategic planning and debugging skills. Educational programs which 
move students along t^is chain will culminate in important cognitive 

cutcor-es. 

Instruction in cOTputer learning environments will be especially 
effective i^ the c^iain of cognitive consequences is clearly delineated 
so t^'dt preliminary experiences are designed with the ultimate outcoinc 



In mind. Instruction ifhich stresses the cognitive outcomes most 
likely to result from computer learning envirof^nts will intensify 
the experience and Increase the likelihood that students will gain 
cognitlvely useful Infonaatlon froa the learning experience. 

Currently, the most cognitlvely demanding classroom use of the 
computer Is pr(rt>ably for learning to program. Activities which lead 
to progransrfng expertise can form a chain of cognitive conseqwnces 
from cwnputer learning. Skilled progranniers use strategic planning 
and debugging skills extensively. Students who learn to progrffir the 
computer can acquire strategic planning and debugging skills, how- 
ever, progranwilng courses do not necessarily provide direct Instruc- 
tion on these skills. 

Prograiming instruction which focuses only on acquisition of 
language features and not on hm to corsbiiw the language features, 
may fail to foster strategic planning knowledge in students. We can 
encourage cognitive outcwnes from c^uter learning enviromnents by 
assigning problems which demand the skills desired. On the other 
hand, problems which focus primarily on input and output such as 
reading in "name", printing out "name", and so on are unlikely to 
require strategic planning. In contrast, problems requiring stu- 
dents to write guessing game programs do require strategic planning. 
To write a program which gives a player seven chances to guess a num- 
ber between one and one hundred and gives feedback about whether the 
number guessed is higher or lo»«r than the number the computer has 
in mind, requires a series of decisions. The programiThjr imist decide 
when to generate the computer nuirt>er, how to keep track of the num- 
ber of guesses, when lo give feedback to the pTaycr, etc. Problems 
which demand strategic planning and which are complex enough that 
they require students to do debugging Increase the likelihood that 
students will acquire higher cognitive skills from computer learn- 
ing environments. Activities which lead up to problems which demand 
strategic planning form the chain of cognitive consequences of com- 
puter learning envirorenents. 

Instruction can make explicit the skills required for strategic 
planning and debugging, thus fostering movement along the chain of 
cognitive consequences The ACCCEL project has devised a series of 
techniques for explicitly encou. aging planning and debugging. For 
example, instruction which recuires students to make an action dia- 
gram of their program prior t( writing code encourages students to 
think about planning. In addition, instruction which requires that 
students describe at least tw hypotheses to explain a bug in their 
program, before trying to fix it, encourages students to develop de- 
bugging sifin. In contrast, educational programs which allow stu- 
dents to compose their progiams at the keyboard may result in 
studerts writing what has been called "spaghetti code", that is, 
code which is totally unplanned. Educational programs which pay no 
attention to debugging may encourage haphazard substitution of new 
code rather than analysis of what went wrong. In the section on 
teacher professional development, we discuss in greater detail the 
advantages and disadvantages of explicit instruction for develop- 
ment of higher cognitive skills such as strategic planning. 
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Pre-college education courses can foster cognitive outcomes by 
providing an introduction to the Infonwtion which students might 
use in coioputer-related careers and computer-based problem solving 
in college courses. The problem-solving skills of strategic plan- 
ning are likely to figure strongly in this instruction. In 4iddition, 
expert computer problem solvers have developed a repertoire of effec- 
tive templates for solving problems in their sid)ject matter area. 
For example, they develop "sorting" tetitplates. Introductory comput- 
er courses can and should provide an introduction to these templates. 
As students gain a repertoire of templates, such courses can also 
help students develop criteria for selecting an appropriate template 
for a problem. If the ability to select an appropriate template for 
a problem is en^hasized, it is more likely that each additional com- 
puter learning course will allow students to advance along the chain 
of cognitive consequences. 

The cognitive consequences of programming might include general- 
ization to non-computer environments. It has often been pointed out 
that transfer from one learning environment to another is infrequent 
and, at best, difficult to accomplish. Recently, researchers have 
identified meta-reasoning skills as possible si*ject matter and con- 
text independent problem-solving skills used by students. Strategic 
planning can be seen as one of these skills. Strategic planning is 
often acquired in a specific subject matter area. It is not uncommon 
for students to have difficulty discerning which information is sub- 
ject matter- specific and which is subject matter-independent. Only 
after a long series of problem-solving experiences do students start 
to recognize which skills are independent of subject matter and which 
are tied to subject matter. Courses which provide many problem-solving 
opportunities and help students recognize their meta-reasoning skills 
have the potential to enhance problem-solving skill in new domains. 

In summary, optimal cognitive consequences from computer learn- 
ing environments are freqi«ntly prevented because instruction fails 
to emphasize them. School-based planning can change this situation. 
Much of computer instruction involves drill and practice, which rarely 
emphasizes higher order problem-solving skills. Even instruction in 
programming, which has the potential for emphasizing higher order 
skills, frequently fails to do so. Much of computer progranmiing in- 
struction, as it is currently practiced, focuses on language features 
rather than on how to combine those features to solve problems. Thus, 
to enhance the cognitive consequences from computer environments for 
learning, computers must be used for solving complex problems and in- 
struction must be geared toward planning and debugging rather than 
toward acquisition of language features. 

Implementing a plan . Planning for effective computer-based in- 
structional programs in schools involves specification of desired out- 
comes in a chain of cognitive consequences including the impact of 
computer-based programs on other portions of the school curriculum. 
It is useful to consider, for example, how courses such as typing and 
nathematics might be affected by an increase in the nunrtser of pupils 
who have computer expertise. Although such forecasting is admittedly 
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difficult. It Is required In order for schools to have effective 
responses to this Important educational Innovation. 

Effective planning for cognitive outcomes from computer learn- 
ing also requires coping with the Irspedlments discussed above. Oe- 
cfslons about hardware selection, softMare selection, and curriculum 
design often seem fraught with difficulty. Hardware selection depends 
on the products on the market. The available hardware In the area of 
computer education Is rapidly changing. If one waits for the price 
to cane down or for the best product to be devel^d, one will wait 
forever. Decisions have to be made based on what Is currently avail- 
able. Sometimes It Is frustrating to mke these decisions, however, 
they cannot be avoided. Computer learning can occur on a variety of 
available microcomputers as well as larger computers. It Is desir- 
able to select hardware which riHis the software that you most want 
to use In your program and not to assume that "promised" sof^are 
will necessarily be available later on. Incisions have to be made 
using the hardware and software currently available and assuming 
that although the situation will change It Is not possible to anti- 
cipate the direction of that chaise very effectively. 

The selection of software for cwnputer-oased environments should 
reflect the cognitive conseqt«nces which an? desired. Currently, 
only a small portion of the available curriculum materials emphasizes 
strategic planning and debugging, which seem to be onong the most 
unique and valuable cognitive consequences from computer learning 
envlronnents. 



Planning for Affective Consequences 

Computer learning envlronnents have the potential for influencing 
affective outcomes as well as cognitive outcomes. A diverse group 
of affective consequences of the computer learning enviroranent must 
be considered in school-based planning. 

First, computer education programs can help overcome apprehen- 
sion sometimes assMiated with computers. Some students express 
apprehensions about breaking the computer or concern that the com- 
puter might gain control of them in some sense. For almost all 
learners, this apprehension is overcome quickly because it stems 
from lack of complete knowledge of the environment. For a few 
learners, more comprehensive programs such as those developed by 
the EQUALS program at the Lawrence Hall of Science are needed. 

Second, computer education programs can build self-esteem and 
confidence in one's ability to use computers. Programs which pro- 
vide the opportunity to use higher cognitive skills have a greater 
potential for fostering such affective consequences. Recently, we 
observed a '2-year-old girl solving a complex graphics problem 
while muttering to herself, "I'm so smart, I can do this." The in- 
teractive nature of the environment allowed her to see and correct 
her mistakes and to recognize that she was makirg progress on a 
non-trivial problem. 
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Tttlrd. students can gain confidence and skill In learning au- 
tonomously frost the cos^uter environment. Much of student learning 
occurs autonomously, but often It Is Inefficient and Ineffective. 
The opportunity for Interaction and precise feedback when using the 
computer allows learners to engage In pro^tlve autonofoous learning, 
to succeed on difficult problems, and ultimately to gain confidence 
that they can solve complex problems on their own. 

Evidence for autonomous learning comes from the many junior 
high and high school students who become "expert" progr«nmers, even 
though courses available to these students typically prov1(te only 
an Introduction to the si^ject. In spite of this limited exposure, 
a reasonable number of students learn to program complicated problem 
solutions. Many of these students have computers at home, others 
have access to computers during afterschool hours at libraries, mu- 
seums or computer stores. Computers provide a vehicle for s 'udents 
who desire to learn autonomously to achieve a satisfying outcome. 

Fourth, well-planned computer learning experiences have the po- 
tential of ensuring that computers will be viewed and used as tools 
to foster humanitarian goals rather than as means to the mechaniza- 
tion of society. Students who collaborate with their peers to solve 
problems using the computer are likely to s^e how this tool can help 
society. Currently, computer classrooms are among the most Interac- 
tive. When students encounter bugs In their programs, th^ generally 
seek help from peers. Often, students work In teams to design and 
Implement problem solutions. If the problens are complex and If the 
Instructor rewards group work, students often learn to value the con- 
tributions of their peers. For example, a group of students Is far 
more likely to generate several possible hypotheses for a program 
bug than Is an Individual. Although It Is difficult to organize a 
classroom so collaboration Is rewarded, the payoff both In problem 
Solving and In "humanizing" the role of the c<mputer makes such ac- 
tion twrthwhile. 

Implementing a plan . Planning for effective affective outcomes 
Involves considering both the cognitive demnds of the learning en- 
vironment and the desired affective consequences. Apprehension can 
be overcome most quickly if computers are fun to use. Self-esteem 
increases when students solve complex problems. Students are likely 
to learn autonomously only if they are given problems to solve on 
their own and if the feedback available provides encourageircnt. Fi- 
nally, learners are likely to see the value of computers to humanity 
when they use it as a tool to foster communication between themselves 
and their peers. 



Planning for Equitable Outcomes 

A concern in fostering student outcomes from computer learning 
environments Is the equitable distribution of those outcomes. Lack 
of access to computer instruction Is the major factor which prohibits 
equitable outcomes from computer learning environments. Females and 
students in low socioeconomic groups are considerably less likely 



307 

3^8 



\ 

\ 



to access to computers than mles and those of h^qh socio- 
econofQU status (see Tables 2 and 3). Unless this trend Is reduced 
or elfoilnated. Me can anticipate a strong effect on society. Wid- 
ening the gap bet*<e€n those who have .technological competence and 
those who do not, fwther limits the learning potential of those who 
fall to gain technological ex{wrt1se. The Inequitable distribution 
of computer learning experiences Is already a serious problem; steps 
must be taken to alleviate It. 

Data on the participation of males and females In computer 
learning environments are reminiscent of the situation in advanced 
mathematics courses which was ptd}lic1zed in the late 1960's. In 
California, of the 27»378 students enrolled In c«^uter program- 
ming classes In high school, only 37 percent of those students are 
female. Researchers report that less than 30 percent of the students 
at -omputer camps are female. The Lawrence Hall of Science reports 
that approximately 27 percent of students enrolling In computer 
courses are female. Fenale participation In computer learning ex- 
periences Is much lower than that of males. By requiring courses 
in computer learning, schools can help to alleviate the situation. 
By encouraging females to participate in cOTiputer learning experi- 
ences, families can address this Important concern. 

The advantages of galiflng technological expertise have been 
well documented both In the area of potential Income and In the 
area of access to further educational experience. Before computer 
learning experiences become a barrier for future participation in 
mathematics and science courses and in certain high paying careers, 
this trend of unequal participation of males and females in computer 
courses must be reversed. 

Iwpleiwntinq a plan . Planning for computer learning environ- 
ments BiusFTnrnwe"TrrTmportant emphasis on equitable student out- 
comes, including increased opportunities for those who failed to get 
them in early schooling. As the statistics described above point 
out, the inequality of access to computer learning is already a ma- 
jor problem. Planning efforts must include procedures which insure 
equitable participation of males and females and of those from high 
and low socioeconomic groups in computer education programs. Some 
of this planning can occur at the school district level, other im- 
portant plarning must occur at the state and federal level in order 
to insure that both districts with high socioeconomic status as 
well as those with low socioeconomic status provide equitable 
computer learning opportunities. 



Planning Effective Teacher Professional Development 

A major problem in the area of computer environments for learn- 
ing is the lack of training available to teachers in such environ- 
ments. Even when such training is available, very frequently school 
districts lack funds for it. Teachers are frequently asked to teach 
computer-based courses with little or no lead time for planning, 
minimal training and minimal resources. 
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Table 2 

Participation of Males and Females In 
Computer-Related Activities 



Enrollment in High School Computer Classes in California 
\ timber Percent 
Class Enrol led Fenwle 

t 



t 

Word Processing 


1,024 


87 


Data Processing 


600 


S6 


Computer Literacy 


9,044 


43 


Computer Programming 


27,278 


37 


Other Courses CcHnblned 


13,335 


47 



Total 51,481 42 



Enrollment In Lawrence Hall 


of Science Computer Classes 


. 1981-1983 


Class 


lumber 
Enrolled 


Percent 
Female 


Micros for Micros (Games) 


171 


37 


Creative Play (Games) 


600 


3D 


Beginning BASIC 


998 


26 


Pilot 


284 


33 


Intermediate BASIC 


378 


19 


Other Courses Combined 


262 


23 


Total 


2,693 


27 



Majors in Computer Science at U.C. Berkeley 23% female. 
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Table 3 

Availability of Htcrocomputers* 
by Soclo-Econoreic Status (SES) 





Predowlnaritly White 


Predominantly 


All 




High 
SES 


Middle 
SES 


Low 
SES 


Ml norl ty 
Elementary 




Median t of 
students who use 
microcomputers 
In a Meek 


24 


22 


12 


13 


16 


^dlan minutes 
of use per week 
of student user 


24 


22 


35 


18 


23 


Percent reporting "intensive" 


use of microcomputers 




for dril 1 and 
practice 


13 


18 


9 


33 


18 


for programming 


21 


17 


49 


10 


23 


with "above 
averdie" students 


24 


30 


51 


26 


31 


with "average** 
students 


14 


9 


22 


12 


12 


with "below 
averaqe" students 


16 


12 


10 


32 


14 



Taken from School uses of microcom p uters ^ Issue 3, October, 1983, 
Center for the Social Organization of' Schools, The Johns Hopkins 
University, Baltimore, Md* 
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Although tlie najorlty of teachers providing coo^uter learning 
envlroraents lack high levels of exfmrtlse In coi^uter education, 
there Is a core of expert teachers and their skills must be capital- 
ized upon. Rather than having one teacher after another reinvent 
excellent procethires for teaching con^uter |H*ograimn1ng and problem 
salving. It Is essential that expertise that has been developed be 
shared. Many successful professional developiaent progress for 
teachers capitalize on helping expert teachers make their expertise 
explicit and share It with other teachers. For example, the Bay 
Area Writing Project and the Bay Area Mathematics Project bring 
teachers together, have them share their Ideas, and start to make 
their expertise explicit. 

Recent advantages In psychological and educational research 
have, In many cases, been consistent with the Ideas of thoughtful 
and expert teachers. Khen teachers are asked to make their knowledge 
explicit, the relationships between their knowledge and the findings 
of recent research can be articulated. Research findings combined 
with the knowledge of expert teachers can be used to develop effec- 
tive professional developront pri^rams. 

An example of the Interface between teacher expertise and recent 
research occurs In the area o* explicit procedures for problem solv- 
ing. Teachers freouently employ discovery learning procedures rather 
than explicit Instruction In problem solving, although critics some- 
. times claim that discovery learning Is too time consianlng and that 
explicit Instruction for solving the problems would be more effec- 
ti«-e. The preference for discovery learning frequently voiced by 
expert teachers Is reflected In recent research. This research re- 
veals that explicit or direct Instruction tends to have value for 
some learners. Explicit instruction apparently helps learners who 
have no clues «s to how to proceed In a given problem-solving situa- 
tion and who require considerable Instructional support in order to 
solve problems. Tl»se learners are usually of lower general ability 
than learners who respond well to discovei^ learning. In addition, 
they frequently have less experience with the subject matter domain 
than those who perform well in the discovery learning mode. 

On the other hand, students who profit from discovery learninp 
are generally high ability students who have sofl» knowledge of the 
subject matter area. These students profit more from discovery 
learning than from explicit instruction oecause they are able to de- 
vise their own algorithms and heuristics for solving problems. If 
algorithms or heuristics for problem solving are provided for them, 
then these instructions may duplicate their own problem-solving pro- 
cess and may dissuade students from developing an "understanding" 
of how to solve the problems. 

Thus, an aptitude treatment interaction where students with 
high ability are encouraged to learn i Mscovery mode while those 
i*Uh low ability are provided with dir , instruction Is suggested. 
Results from one of the ACCCEL research studies which Investigated 
student performance on WUMPU5 tends to support this point of view. 
In th^t study, explicit instruction was helpful for low-ability 
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learners while mae hfgh-ablHty learners profited froei a mre 
discovery-oriented fom of Instruction. 

Thus, teacher professional development can be fostered by capi- 
talizing on the knowledge of expert teachers and by relating that 
knowledge to recent -research advances. Together, these two forms 
of Information can be cttubln^ to create better Instructional pro- 
grams than either form would provide on Its own. 

Teacher professional developnent can also be fostered by the 
networking of teachers to share es^clally effective practices. 
Networking of teachers has the advantage of encouraging the dissem- 
ination of InfoHMtlon developed at local sites and freeing teachers 
from the necessity of reinventing procedin^s. 

Iwplementing a plan . Teacher professional develof^nt must be 
an important coisponent of any plan for coRq)uter learning. It is un- 
reasonable and ineffective to assume that Targe numbers of teachers 
win train themselves to use such a complicated tool. When busines- 
ses adopt word processing or economic spread sheet software* they 
provide extensive training for the professionals who will be using 
those todls. Similarly, teachers deserve extensive training in use 
of new professional tools. 

There Is a growing understanding of the process of teacher 
professional development. Knowledge is emerging at both research 
universities and local schools. It is necessary to build new models 
for linkages between schools, universities and research agencies 
which fester effective school practice. For example, the relation- 
ship between teachers' perceptions of discowry learning and recent 
research on discovery learning can be Investigated by teams repre- 
senting local school practitioners and researchers. 



A Model of Computer-Based Instruction 

Both the ideas of expert teact^rs and the results of research 
on computer learning environments are beginning to suggest a model 
of computer-based instruction which could have far-reaching conse- 
quences. Such a model is needed to clarify how instruction can 
capitalize on the unique features of computers. For example, the 
enphasis on explicit instruction in conjunction with discovery 
learning becomes far more central in educational decision making 
using computers than it does in other aspects of the curriculum. 
The desired effect from explicit Instruction is frequently not 
acfompllshed in non-computer-based learning environments simply 
because of the difficulty involved in implementing it. C<»nputers 
provide the opportunity for explicit instruction and also provide 
the necessity of making decisions about wtwther explicit instruction 
is appropriate for all learners. 

Computer learning environments provide the opportunity for 
emphasizing aspects of the curriculum that might be difficult or 
impossible to emphasize without computers. For example, strategic 
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planning knowledge Is rarely taught In regular classrooms, slinply 
because it requires a great deal of student and teaclier Interaction. 
Computer environments provide nusierous si^ ject natter areas where 
strategic planning knowledge night be encouraged and where students 
can gain explicit and direct feedback on the effectiveness of their 
strategic planning. Cven when strategic planning Is required In 
non-computer learning environments (such as In the construction of 
geometry proofs), fee^ck mjf be lacking In expllcltness or my 
occur a long time after the problem has been attempted. Computer 
environments provide opportunities for more explicit and more 
Imnedlata feedback. 

Important contributions from both research universities and 
local schools are necessary for the development of a model of 
computer-based Instruction. The Input of expert teachers, as well 
as the results of recent research such as that conducted b the 
ACCCCL project, need to be combined In order to form an effective 
model. Cofi^uter-based Instruction provides an especially exciting 
opportunity for this Interaction. 



Conclusions 

The potential of coa^uters In education provides a rare oppor- 
tunity for educators. The computer can greatly Increase the likeli- 
hood that the educational reforms called for by recent national com- 
missions will be achieved. To accomplish this, we must narrow the 
gap between the promise of computers in education ai^i the reality 
of their use in schools. 

School -based planning can increase the effecifiveness of comput- 
er learning environments. Unless schools responcj to the gap between 
promise and reality In computer education, the gap will widen. The 
impediments to effective c<»!?)uter education\w111 Increase unless 
schools demonstrate that th^ want to use cdmputers to their full 
potential. If schools demonstrate that they^ want cognitively denand- 
ing software and integrated curricula, if schools develop the ability 
to select effective software, and if schools seem to be making in- 
formed rather than haphazard decisions about hardware and software, 
then developers will be more eager to develop products for the 
educational market. 

Schools and researchers can work together to gain more under- 
standing of the potential of the computer learning environment, to 
clarify desired outcomes for students, and to establish the chain 
of cognitive consequences from computer learning environments. Ex- 
pert ivicherz are designing programs to capitalize on computers. 
Research programs such as ACCCEL are conducting investigations of 
the chain of cognitive consequences, examining the responses of 
Rales and femel^'S to computer learning environrnents, and gatheririg 
0tr\pr informati n useful to educators. If these groups work to- 
'jAthf-r, plannir, cdn te simplified. 
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To capital lie on the potential of coiqiuters In education, re- 
sources oust be allocated effectively. The ^^tatlon to purchase 
har^re rather than Investlnf resources In plannlns and In teacher 
professional developfoant nay Inpede optlmuai progrvB develoiHsent. 
The 1sst«s surroimdins It^leisentatlon of coaputer e<&icat1on programs 
are complex; they desert ^lous and ti^iishtful consideration. The 
costs of planning and teacher professional development are small 
relative to their potential benefits. 

Ult1<Mtely, effective use of coE^uter learning envlronnwnts 
requires the design of hardware* softnare, and currlculiffl materials 
focused exclusively and specifically on the problems of schools. The 
development of such a response requires the co^ratlon of schools, 
state governments, federal governments, and research agencies. VI th- 
ou t the effectlw Integration of all of these agencies, we can con- 
tinue to expect to see spor^lc and Incomplete efforts In coo^uter 
learning and we can continue to expect to hear about the gap between 
the promise of cos^uter learning environments and the reality of In- 
structional use of coii^uters In schools. The macro expectations for 
computers In education will be met with micro outcomes unless thought- 
ful individuals and substantial resources are devoted to this problem. 



The potential for the use of computers In the instructional en- 
vironment Is phenomenal. It would be Irresponsible to Ignore this 
potential. Substantial, serious, and concerted effort Is needed In 
order to Incorporate this new and effective educational tool Into 
creative, innovative, and extensive educational programs. 



31* 315 



' 'Perhaps the r7K>st uniqt^ asp&:t atxx/t comfXJters in education is that 
the influx ofcomfxAers into ttm «:/KX)fe has been a grassroc^sf^Tenome- 
noa and not a top^kywn innovatk)n. The most comma) manner in which 
computers appear today in the classroom is due to the efforts of a par- 
ticular teacher who has become interested in their educational applica- 
tions and has figured out ways in which to use them in the curriculum." 
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THE CAliFORMA MODEL CURRICUllM FOR COMPUTERS IN EDUCATION 



Wendty Harris 
Manager, Educational Technology 
California State Department of Education 

V ii be talking today about a project that we have underway at the State 
Department of Education* But to put this project into some context, it might be 
helpful to say a few words about the current status of computers in the schools , 
why this so-called revolution Is so unique » how the state fits into this situation, 
and how the model curriculum project came to be in light of our perception of the 
state's role. 

Unique Aspects About Cc^puters in Education 

Perhaps the aost unique aspect about cmoputers in education is that the influx 
of computers Into the schools has been a grassroots phenomenon, axul not a top- 
down innovation. The most common manner in which computers appear today in the 
classroom is due to the efforts of a particular teacher who has become Interested 
in their educational applications and has figured out ways in which to use 
them in the curriculum. This is in contrast to the sore traditional approach of 
a top-down innovation^ where ^ for example, the state or perhaps a district 
mandates a particular learning apprc^ch (e«g. , language labs) without proper 
training, without widespread school and community supiK>rt|, and with no sense of 
integration within the curriculum. 

A second aspect about computers in the schools is that the grassroots nature 
of the movement has generated a tremendous amount of enthusiasm about teaching 
in general. In the face of low salaries, not altogether ideal working conditions, 
and other barriers, teachers tend to be highly enthusiastic about the use of 
computers in their classrooms. I believe this is translating into a greater 
excitement about t teaching in general than we have seen for a long time. 

Finally, unlike the influx of TV, language labs, and other so-^called tech- 
nological innovations, computers appear to be here to stay. Asstsming current 
problems such as lack of sufficient in-depth training and lack of innovative and 
high quality software can be addressed, computers have the capacity to revitalize 
the educational system. 

What Is It About Computers That Makes Their Use in Education So Exciting ? 

1. They give students th^ capacity to acquire information efficiently, and 
throuKh another medium. In this process, computers teach valuable skills 
that will help students live and work in the "information society. 

J, They present possibilities for teaching subject matter outside the regular 
curriculum, and in some cases, beyond the specific knowledge of the teacher. 

3. They provide feedback to the Individual learner, allowing pacing according 
to the learner's capability. ^ 

4. They open up the possibility for learning that is inherent in simulations 
ttwH might otherwise be too costly or dangerous. 
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5. Through experiences such as prografflmlng, they develop the capability of the 
learner for more logical thinking ai»i analysis skills « 



Role of the State in increasing the Effective Use of Computers In Education 



So, where does the state fit into this apparent rosy picture of ccwputers 
in education? Actually, the picture is not quite so rosy, at least not yet* There 
are real impleoentdtion probleas to be solved in the areas of training, hardware, 
software, and curriculua develo}»ient. In addition, equity considerations are 
looming on the horizon as a major area of concern* 

We see the role of the state as one of addressing equity aiul other such 
problems that act as implementation barriers to effective utilization of computers 
in education. Another problem area, in addition to equity and which is the 
subject of today's session, is that of effecting whatever changes are needed in 
curriculum so that computers can serve as effective learning tools to promote 
the educational goals and priorities of the schools. 



We felt that one of the most useful things the state could do is to provide 
schools with a rich and varied source of ideas for improving the general educa^ 
tional level of the schools through the use of computers and computing. Thus, 
we are in the process of developing a computer education irodel curriculum* Its 
final title will be '^Computers in Education: Goals and Contentii'' 

Background and Rationale for Project 

Many groups recently, most notably the National Commission on Excellence 
in Education, have ca.Ued for a refocusing on the "very study" of education-* 
the core curriculum for areas often referred to as the New Basics (English, 
math, science, social studies, and computer studies). In California, the 
Superintendent has made the developwnt of a "core curriculum^-^substant ive 
statements of expectations for student knowledge, skills, and concepts— a 
priority mission for the State Department of Education. 

It is our hope that such a series of statements will help mobilize the edu- 
cational system to set and achieve a high level of expectations for students^ 
The intent here is to raise both the floor and ceiling of student achievement— 
not produce yet another "minimum" proficiency. It is also our hope that strong 
statements will help drive other parts of the system. For example, internally, 
it could drive development of handbooks, frameworks, and testing. Externally, 
it could drive teacher training, local curriculum, and textbook content. 

Finally, another rationale for this project is a mandate in SB 813 for the 
State Board of Education upon the advice of the Department, to adopt a model 
curriculum in computer studies for students in grades K-12. 

Process of Development 

The content of the document was produced by a small working committee, with 
ri»presenCat ives from schools, district and county offices, and TEC Centers. The 
review process contains several steps. We now have a go«i working draft of the 
dorumpnt. The next step will be a broad field review of perhaps 40 individuals. 



The Model Curriculum for Computers in Education 
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In addition. Informal speaking engagements such as this are excellent ways 
for us to set feedback. We expect to publish the document by around February. 
A usable draft should be available just after the first of the year. 

What the Curriculum Is and Isn*t 

This curriculum provides the state's perspective on the uses of cosputers In 
education and what knowledge^ skills, and values all students should acquire 
about computers by the ti»e they graduate. The document takes the point of view 
that while there clearly will be different levels of expertise developed in each 
skill area, all students should be provided the opportunity to use the j^wer of 
coaputern in different ways and in many different subject areas. 

The curriculum is a document intended for all educators. However, it should 
be m'>st useful for purposes of driving local curriculum development. This is 
not a scope and sequence from the state. Such an effort should be locally 
developed. Moreover, this is not meant to be a rigid document. As technology 
chart^^es. It too must change. 

The rurrlculum also serves as a vehicle to send certain messages regarding 
Che uses for computers in schop.ls. For example: 

• Extensive hands-on experience* must be provided for all students at all 
grade levels 

• The most beneficial experiences are those in which the student has con- 
trol over the computer 

• The use of computers should be integrated throughout the currlcuJum at 
all grade levels 

• All students should learn to program the computer to some level of 
proficiency 

• The romputer provides a powerful and direct way to teach critical thinking 
and problem-solving skills 

Fin,iUy, the document itself serves as the state's definition of computer 
Hter.4cy. Computer literacy is not defined specifically as a term in the docuu^nt. 
Hath»ir« by laying out a hroad array of skills and knowledges, it covers all the 
topics that could conceivably be bundled under the rubric of computer literacy. 
Any educator wishing to design a computer literacy program will find all the 
relevant content in the model curriculum. 

o r ,1 n i za t iun of t he Document 

The document is deliberately organized to provide for flexibility in local 
curriculum development. It doesn*t specify exactly what should be taught when. 
The tive m.ijor sectirjns, or strands, should be thought of as running in parallel, 
with I ^iven use of computers p.ddressing skills and knowledge from several strands. 
Skills in initial strands are not intended to be completely addressed before 
skills in other strands are initiated. The strands are: 

• OpMf^itlon of Computer Systems 

• (lompiitt^r Applications 
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• Thififclng Skills Through Programiaing 

• Ccmputer Science 

• Societal Impact of Coffiputers 

Content of the Model Currlculim 

a. Operation of Computer Systeips 

This strand deals with skills and knowledge students require in order to 
successfully and safely operate a cosputer systes. It is iaportant that the 
content of this strand l» taught in a hands-on fashion in conjunction with 
aaterial froa other strands* 

Thus, young students should be learning to identify and use alphabetic 
and numeric keys in the context of using instructional software or a simple 
programming language* These experiences should begin as early as possible 
in a student *8 educational career* preferably in the elementary grades. 
Students need to acquire knowledge and skills in the following areas: 

(1) Keyboarding skills 

(2) Systems components— for example, knowledge of how a system is put 
together, «#hat role various storage devices play, how telecommunications 
systems work 

(3) Computer operation — in essence the ability to perform basic tasks with 
software, e#g«, load, list, erase, break, etc. 

(4) Computer applications — this is dealt with quite substantively in the 
next strand # In this strand, the intent is to have students acquire an 
awareness level of knowledge about such applications as word processing, 
spreadsheets, data base and file managers, graphics programs, program- 
ming languages, and when they might be most useful. 

b» Appl ications 

This strand has to do with using computers as a twl to accomplish 
certain tasks* We don*t regard applications in the narrow sense as data 
base management programs, spread sheets, or word processing, buL rather as a 
continuum from Computer Assisted Learning (CAL) material through these 
applicatidns I just mentioned to programming itself* That is, the computer 
can be applied in an educational setting in all of these ways* 

Underlying this continuum is the idea of student control over the com- 
puter* At one extreme, drill and practice, as one form of CAL, represents 
an activity in which the student essentially has no control over content 
or pre»ent*itlon strategies* Formal programming, on the other hsnd, puts the 
student fully in control of the computer and its operation. Other types of 
cippl ications lie somewhere between these extremes; the level of control 
di^pends on the specific application* 

In each of the general classes of applications I will mention, there is 
a broad range of skills to be taught and the software that can be used 
r/in)?os from the relatively simple to very complex* The particular subject 
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areas to which they are applied and the specific software that will be used 
will depend upon the level of sophistication of the teacher and the develop* 
Biental level of the students. The following are the general classes of 
applications: 

Cooputer Assisted Learniog (CAL) 

The currlculuta describes CAL materials In terms of drill and practice, 
simulations, tutorials, and educational gaiMS. The point is made that all 
students should have as many opportunities as possible to use these appllca* 
tloos throughout the currlculiun. Furthermore, in planning CAL activities^ 
in addition to selecting materials with the appropriate content and level of 
difficulty, it is important to consider what critical thinking skills students 
have to aaploy in working the materials, and the level of control they have 
over the computer and the educational content* 



Word Processing 

Electronic Spreadsheets 

Data Bsse Managers 

Thinking Skills Through Pro^ raa mlng 

This model curriculum is based on the premise that all students should 
be provided with the opportunity to learn the fundamentals of computer 
programming. Among the most important reasons for this premise are that: 

il) Programming puts the student in control of the computer, providing 
a sense of power and accomplishment and enhancing self-*e8teem« 



(2) Programming provides a very direct method of teaching a wide range 
of critical thinking skills, problem-^solving skills, and communica- 
tion skills* It is these which we feel are among the most enduring 
types of skills that are acquired throughout schooling. 

(3) Programming a computer provides unique insights into the relation- 
ship between people and machines, thus demystifying the machine* 

(4) As with language arts and reading, once a student has mastered 
some elementary thinking skills, they can be put to work in other 
areas of the curriculum* 



The skills and examples in this strand are generic in nature and are 
Intended to make explicit the primary purpose for teaching programming — the 
acquisition of a set of problemrsolving skills and strategies that are 
computer language Independent and applicable to problems In a wide range of 
subject matters* An Important concept In Implementing this curriculum Is that 
Mch of the gen^^ric problem-solving skills should be addressed many times in 
dltferent content areas and In ever more complex situations* 

Tht* following are the problem-solving skills described in the model 

curri cuium: 



i 1) DfHrribing the problem in your own words 

(2) Bri»akln« down the problem into manageable pieces 
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(3) Developing algorithos 

(4) Anticipating outcomes and unforeseen events 

(5) Gei^ralizing a problem solution 
(6} Debugging 

(7) Cotasunication afcllls 

In teaching ebese chii&ls^ skills through programalngy there is clearly 
a set of prograffioing skills per se that have to be taught. These are primarily 
language independent » although some rie mt postiible at all in s<»e languages 
and others such easier in soro languages than in others. Examples are: 

(1) Define and use simple procedures and subroutines. 

(2) tise control structures for sijnpie iterations (loops and recursions) 
and choices (branches). 

(3) Oi^flne and use numeric and string variables. 

(4) Design appropriate error trapping routines* 

A fuller list is provided in the model curriculum Itself. 

d. Computer Science 

This section of the curriculum describes content that is primarily 
elective in nature. In general it w>uld be taught in a formal computer 
science course. It is not suggested that all, or nearly all, students would 
be capable of mastering this content or of t^nefiting from it. It is 
Important to point out» hovwver^ that this material overlaps with that In 
other strands, and that what Is covered with students should be dependent on 
their skills and interests, not on some arbitrary division of content. 

Skills and Knowledges 

• Understand the use of high-level languages* compilers, and interpreters* 

• Understand the use of assembly language a^d assemblers 

• Understand number systems used in computers 

• Understand various data representation schemes 

a Understand how data is stored and accessed In memory and on discs 

a Understand the basic architecture of computers 

• Understand elementary electronic circuit design principles 

e. Societal Impact 

As with all areas of the curriculum, this one should be covered in a 
wide variety of settings and subject matters. While the proposed content is 
computer related, it cuts across subject matters; the major headings have 
b**en chosen to reflect this. For example, while the ethical considerations 
Hurrcnjnding copyrighted software should clearly be dealt with directly in 
ttie context of computer use, they also have a place in social studies units 
ilpvotfti to societal ethics in general. 



The skills and knowledges in fhls strand fall into the following areas: 

( 1 ) Ethics and Values 

(2) Impact of Computer Technology 

(3) History of Computers and Computing 

(4) Technological Consumer Skills 
{")) Vocational/Career Information 
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